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ABSTRACT 


The  derivation  of  a  summary  measure  which  would  relate  measurable 
photographic  parameters  to  the  information  content  which  a  photointerpreter 
could  extract  from  the  photograph  was  investigated.  Four  parameters  of  quality 
were  chosen  which  describe  image  contrast,  grain,  and  modulation  curve 
(resolution  and  passband).  Image  modification  methods  and  measuring  tech¬ 
niques  which  could  be  used  without  recourse  to  test  charts  were  developed  for 
black  and  white  photographs.  A  thousand  photographs  with  a  range  of  quality 
parameters  were  generated  and  used  in  interpretation  tests.  Standard  statis¬ 
tical  methods  were  employed  in  an  attempt  to  obtain  the  correlation  between 
the  photointerpreter  scores  and  the  measured  variables  of  the  photographs. 
However,  these  procedures  did  not  permit  a  meaningful  summary  measure  to 
be  derived,  primarily  because  of  the  low  scores  achieved  by  the  photointer¬ 
preters  who  took  the  test.  Conclusions  have  been  drawn  relating  to  image 
modification,  measurement  of  quality  parameters  and  planning  of  future  tests. 
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SUMMARY 


The  derivation  of  a  summary  measure  which  would  relate  measur¬ 
able  photographic  parameters  to  the  information  which  a  photointerpreter  could 
extract  from  the  photograph  was  investigated. 

The  four  parameters  chosen  to  describe  photographs  were;  (1)  grain, 
a  measurement  of  the  root-mean- square  density  fluctuation  observed  in  a 
microdensitometer  scan  across  a  uniformly  exposed  area  of  a  film,  (2)  con¬ 
trast,  defined  as  the  average  of  the  six  largest  monotonic  density  changes 
observed  in  a  scan  across  the  photograph,  (3)  passband,  the  area  under  the 
square  of  the  modulation  transfer  function,  and  (4)  resolution,  the  spatial 
frequency  at  which  the  transfer  function  equals  0.  25, 

Two  interpretation  tests  were  conducted  during  this  program.  The 
first  was  a  pretest,  involving  200  photographs,  designed  to  improve  the  modi¬ 
fication  procedure  and  interpreter  testing  methods.  The  second  test  involved 
the  modification  and  measurement  of  quality  parameters  of  1000  photographs  of 
which  760  were  used  in  the  test.  This  test  was  designed  to  determine  the  sum¬ 
mary  measure. 

The  thousand  photographs  were  generated  by  modifying  the  four  para¬ 
meters  in  the  following  manner:  (1)  grain  was  controlled  by  using  different 
types  of  film,  (2)  contrast  was  controlled  by  veiling  exposures,  and  (3)  pass- 
band  and  resolution  were  controlled  by  spatial  filtering. 

Apparent  discrepancies  between  the  level  of  performance  required  on 
the  determination  test  and  the  existing  level  of  subject  capability  created  low 
average  scores  which  made  it  impossible  to  derive  a  summary  measure. 

The  results  of  the  study  include  the  development  of  image  modifi¬ 
cation  procedures  and  the  generation  of  a  set  of  modified  photographs,  the 
extension  of  measurement  techniques  to  provide  quality  measurements  for 
aerial  photographs  without  recourse  to  test  charts,  and  information  regarding 
the  design  of  photointerpretation  test  procedures. 
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I.  INTRODUCTION 


The  study  and  the  experimental  program  discussed  herein  were  con¬ 
ducted  at  the  Cornell  Aeronautical  Laboratory,  Inc.  under  contract  number 
AF  30(602) -2684  from  the  Rome  Air  Development  Center.  The  program  was 
directed  toward  the  derivation  of  a  summary  measure  of  image  quality  for 
photointerpretation. 

It  is  possible  to  formulate  equations  which  relate  the  photographic 
image  produced  by  a  reconnaissance  system  to  the  original  object  scene. 

These  equations  contain  parameters  describing  the  effects  of  atmosphere, 
lens,  film  and  image  motion  on  the  image.  Although  the  values  of  several  of 
these  parameters  still  require  investigation,  and  are  in  fact  being  investi¬ 
gated  on  other  programs,  the  equations  can  be  written  in  general  form. 
However,  at  the  start  of  this  contract,  the  final  photographic  image  quality 
could  not  be  related  by  an  equation  to  the  potential  performance  of  a  photo- 
interpreter  in  extracting  information  from  the  image.  This  missing  link  is 
the  subject  of  the  current  effort. 

If  such  an  equation  could  be  derived,  that  is  a  measure  of  interpreta- 
bility  expressed  as  a  function  of  the  physical  image  characteristics,  several 
uses  are  apparent.  The  summary  measure  of  image  quality  would  provide  a 
rating  scale  with  which  priorities  could  be  established  at  times  when  the 
image  acquisition  process  overloads  the  interpretation  process.  Further,  by 
examination  of  the  components  of  the  quality  measure,  it  would  be  possible  to 
predict  those  cases  in  which  enhancement  is  possible  and  foretell  the  form  of 
enhancement  which  would  be  of  the  greatest  value  in  increasing  the  quality. 
Using  this  approach,  it  can  be  seen  that  the  summary  measure  also  provides 
a  design  criterion  for  the  synthesis  of  new  reconnaissance  systems.  Lacking 
the  summary  measure,  system  optimization  has  been  limited  to  an  intuitive 

proces  s. 

The  basic  philosophy  of  this  program  was  realism,  i.  e. ,  aerial 
scenes  were  used,  interpretation  tests  were  performed  by  trained  photo¬ 
interpreters  and  the  interpretation  tasks  were  equivalent  to  those  normally 
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performed  by  experienced  photointerpreters.  In  order  to  constrain  the  pro¬ 
gram  to  reasonable  test  size,  and  keep  within  financial  limits,  several 
limitations  were  imposed.  Only  monocular  viewing  of  black  and  white  photo¬ 
graphs  was  included  in  this  program.  Since  both  color  and  stereo  would  add 
considerably  to  the  complexity  of  the  physical  description,  the  physical 
parameters  used  are  not  a  complete  description  of  the  image,  but  rather 
are  a  simplified  description  which  is  both  comparatively  easy  to  handle  and 
precise  enough  to  treat  the  more  important  situations.  Finally,  the  ranges 
of  variables  are  essentially  limited  to  those  which  occur  in  present-day 
aerial  photography. 

The  general  approach  to  the  problem  is  shown  in  Figure  1.  Aerial 
photographs  were  selected  according  to  a  set  of  requirements  on  target 
content  (number,  types,  size,  etc.  )  and  scale.  This  imagery  was  modified 
creating  a  set  of  photographs  in  which  the  physical  quality  varied.  The 
needed  parameters  of  each  photograph  were  measured,  and  the  photographs 
used  in  interpretative  tests.  The  performance  scores  of  the  photointerpre¬ 
ters  were  correlated  with  the  variables  of  quality  to  obtain  a  summary 
measure.  This  processes  the  subject  of  the  following  sections. 
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II.  GENERAL  CONSIDERATIONS 


This  section  includes:  (A)  Descriptive  Parameters  and  Their 
Measurements,  i.  e.  ,  the  definition,  measurements  and  physical  interpreta¬ 
tion  of  the  variables  chosen  to  describe  the  photographs,  (B)  Image 
Modifications  which  describes  methods  of  modifying  photographs,  (C) 
Selection  of  Variable  Values,  i.  e.  ,  the  correlation  between  image  para¬ 
meters  and  the  ranges  of  variables  considered  for  this  investigation,  and 
(D)  Selection  of  Photographs  and  other  psychological  considerations. 


A.  DESCRIPTIVE  PARAMETERS  AND  THEIR  MEASUREMENTS 

When  physical  photographic  parameters  are  discussed,  a  long  list 
of  numbers  and  functions  are  used  to  describe  photographic  quality.  For¬ 
tunately,  the  list  can  be  reduced  to  a  few  independent  parameters.  The 
numbers  discussed  in  the  following  sections  represent  a  reasonably  complete 
description  of  physical  photographs,  and  are  those  used  throughout  this 
program.  For  completeness,  however.  Appendix  I  contains  a  brief  des¬ 
cription  of  other  parameters  which  are  used  to  describe  photographs. 


1.  Granularity 

,  A  silver  halide  photographic  image  consists  of  a  set  of  developed 
silver  grains.  Each  developed  grain  is  essentially  opaque,  with  an  essentially 
transparent  gelatin  surrounding  it.  There  is  a  distribution  of  grain  size  with 
the  average  depending  on  emulsion  speed  (faster  emulsions  have  larger  gram 
sizes).  In  the  unexposed  emulsion,  developable  grains  are  randomly  spaced. 
In  the  exposed  image,  these  grains  develop  with  higher  probability  in  regions 
of  greater  exposure.  If  a  uniformly  exposed  film  is  viewed  either  by  the  eye 
or  with  a  microdensitometer,  an  integration  of  the  image  luminance  over  a 
small  but  finite  area  occurs  and  results  in  an  image  which  appears  to  be  a 
smooth  function  with  a  random  fluctuation.  The  smoothly  varying  function  is 
often  called  the  signal  while  the  random  fluctuations  are  denoted  as  noise. 
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This  noise  in  an  aerial  photograph  is  formed  by  the  granular  nature 
of  the  emulsion.  The  noise  is  a  function  of  the  emulsion  used,  the  developing 
process,  the  average  density  level  and  the  spatial  frequencies  over  which  it 
is  measured.  The  first  two  factors  are  not  involved  in  the  measurement  pro¬ 
cess  and  therefore  need  not  be  considered.  The  third  factor  can  be  taken  into 
account  most  readily  by  making  the  granularity  measurement  at  the  average 
image  density.*  While  the  grain  noise  of  copied  or  enhanced  photographs 
can  be  a  function  of  spatial  frequency,  original  photographs  have  a  nearly 
flat  grain  spectrum.  Thus,  the  grain  noise  can  be  measured  in  the  following 
manner.  (This  is  similar  to  the  method  described  in  Eastman  Kodak's  Film 
Data  Book.  )  If  a  photographic  area  receives  a  constant  exposure,  it  can  be 
safely  assumed  that  the  image  "signal"  is  constant.  When  such  an  area  is 
scanned  with  an  aperture  of  area  A,  a  root  mean  square  density  fluctuation 

tr  can  be  determined.  For  a  given  film  and  developing  process,  these  axe 

related  by 


where  O  is  a  constant  called  the  Selwyn  granularity  constant. 

In  this  program,  the  parameter  of  granularity  is  defined  as  the  root 
mean- square  density  fluctuation  of  a  uniformly  exposed  area  of  the  scene. 
This  corresponds  to  the  number  O'  in  the  preceding  equation. 

The  granularity  is  measured  in  any  uniform  area  whose  density  (by 
visual  inspection)  approximates**  the  scene  average  (such  as  the  roof  top 
shown  in  3  in  Figure  2).  The  aperture  used  by  Kodak  (Film  Data  Book)  is  a 
24/^  diameter  circle,  but  for  convenience,  a  10/^  diameter  circle  was  used 
in  this  study  and  when  necessary  for  comparison  correct  by  the  relation; 

=  a-'D 


It  is  important  to  note  that  granularity  is  a  physical  measure  of  an 
emulsion  characteristic  and  should  not  be  confused  with  the  "grain¬ 
iness"  which  is  the  impression  of  grain  when  a  photographic  image 
is~  viewed. 

Since  granularity  varies  slowly  with  density,  the  choice  of  density 
level  is  not  critical. 
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where  o-"  is  the  granularity  measured  with  a  circular  aperture  of  diameter 
D  (in  microns)  and  the  granularity  value  corresponding  to  a  circu¬ 

lar  aperture  of  24/^  .  The  area  is  scanned,  providing  a  trace  as  shown  m 
3  of  Figure  2,  and  the  data  were  simultaneously  sampled,  converted  to 
digital  form  and  punched  on  paper  tape  for  direct  input  to  an  IBM  704 
computer.  Approximately  1000  sample  points  were  collected.  A  computer 
program  did  the  following,  (1)  computed  the  average  density  and  the  root 
mean  square  density  fluctuation  (  O'  ),  of  all  the  recorded  points  of  a  given 
scene,  (2)  separated  density  fluctuations  from  the  average  density  into  two 
groups;  those  greater  than  2  and  those  less  than  2  O'  .  This  technique 

avoided  the  inclusion  of  transient  and  unusually  large  fluctuations  of  density 
due  to  scratches  and  dust  spots.  (3)  Using  only  the  points  belonging  to  the 
"less  than  2.  o~  "  group,  an  average  density  and  a  cr  were  again  calculated. 
This  new  value  of  o'  was  the  parameter  of  granularity  used  in  this  program. 
All  density  points  were  punched  at  a  rate  providing  approximately  two 
samples  per  effective  diameter  of  the  aperture.  No  variations  in  CT  were 
observed  when  the  counting  rate  was  reduced  to  one  count  per  effective 
diameter.  Measured  values  of  cr  fall  in  the  range  0.  02  to  0.  1 6. 

2.  Contrast 

In  this  program  "contrast  of  a  photographic  scene"  is  defined  as  the 
average  of  the  six  largest  monotonic  density  changes  which  occur  m  any 
microdensitometer  trace  of  the  photograph.  The  mechanics  of  the  measuring 
process  are:  (1)  a  microdensitometer  measurement  was  made  of  the  density 
as  a  function  of  position  on  a  portion  of  a  representative  line  across  the 
photograph.  (2)  From  this  density  trace,  the  six  largest  monotonic  density 
changes  were  determined  and  averaged.  (3)  This  dimensionless  number  was 
designated  as  the  contrast  (See  1  on  Figure  2). 

All  measurements  of  contrast  were  performed  on  a  standard  Ansco 
Model  4  microdensitometer  equipped  with  a  special  stage  capable  of  handling 
film  up  to  a  9"  x  9"  format.  A  circular  aperture  of  approximately  100//- 
effective  diameter  was  used  in  the  scans.  This  was  large  enough  to  integrate 
over  small  fluctuations  due  to  grain  but  small  enough  to  see  the  salient 
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features  of  the  scene.  The  trace  was  selected  to  cross  some  detail  and  the 
direction  of  scan  was  arbitrary.  This  precaution  was  used  to  prevent  scan¬ 
ning  only  water  in  a  seashore  scene.  Scans  across  the  same  photograph  but 
in  different  directions  yield  contrast  values  which  agree  to  within  15%. 

In  defining  a  scene  contrast  by  this  method,  three  cases  can  arise. 
The  measured  contrast  of  the  selected  targets  and  their  immediate  surroun¬ 
dings  can  be  larger  than,  the  same  as  or  less  than,  the  contrast  of  the 
general  background.  In  the  first  two  cases,  the  density  difference  of  the 
targets  and  their  surroundings  should  yield  a  contrast  value  which  is  the 
same  as  the  scene  contrast  and  be  a  logical  extension  of  the  usual  definition 
of  contrast  of  a  single  object  surrounded  by  a  uniform  background.  In  the 
third  case,  the  scene  contrast  will  be  larger  than  the  target  contrast.  While 
such  a  case  gives  an  excessive  contrast  value  as  far  as  relating  photointer¬ 
preter  performance  to  scene  contrast,  it  should  still  be  a  reliable  quality 
measure  of  the  scene.  The  majority  of  militarily  significant  targets  can  be 
classified  in  the  first  two  groups,  but  a  number  of  photographs  do  occur  in 
the  third  category.  A  specific  example  of  such  a  situation  would  be  an 
underground  missile  complex  located  in  a  high  contrast  background  of  black 
mountains  and  snow.  In  this  example,  the  P.  1.  would  see  a  small  density 
difference  between  the  target  (launch  pad)  and  their  surrounding  (low  target 
contrast)  whereas  the  snow  alternating  with  the  black  mountain  would  produce 
a  much  larger  difference  of  density  (large  scene  contrast). 

Measuring  the  contrast  as  the  average  of  the  six  largest  density 
fluctuations  occurring  in  the  scene  is  also  obviously  independent  of  any  large 
scale  uniform  exposure  gradient. 

3.  Passband  and  Resolution 

The  fidelity  with  which  each  object  point  is  reproduced  in  the  image 
can  be  described  by  the  intensity  distribution  of  the  image  of  one  point,  which 
is  commonly  called  the  "point  spread  function"."  It  is  common  practice 


This  function  and  the  others  that  follow  are  described  in 
detail  in  Appendix  II. 
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in  optics  and  photography  to  use  the  Fourier  transform  of  the  point  spread 
called  the  "optical  transfer  function"  which,  in  general,  is  complex  and  a 
function  of  two  spatial  frequencies.  However,  for  the  remainder  of  this 
report,  only  the  absolute  value  of  the  optical  transfer  function  will  be  of 
concern  and  will  be  referred  to  as  either  the  "modulation  transfer  function", 
"modulation  function"  or  "modulation  curve".  Moreover,  this  report  will 
130  concerned  with  the  one  dimensional  modulation  function  resulting 
from  a  cross  sectional  cut  through  the  origin  of  the  two-dimensional  modu¬ 
lation  function  and  unless  specifically  stated  to  the  contrary  will  be  implied 
every  time  the  words  "modulation  transfer  function"  are  used. 

The  modulation  curve  can  be  measured  for  a  system  by  photo¬ 
graphing  a  set  of  test  charts  which  have  an  intensity  that  varies  sinusoidally 
with  position,  and  in  which  the  size  of  one  cycle  of  the  sine  wave  is  different 
for  each  chart.  The  ratio  of  the  contrast  modulation  (brightness  difference 
divided  by  average  brightness)  of  the  image  to  that  of  the  object  is  plotted  as 
a  function  of  spatial  frequency  (number  of  sine  wave  cycles  per  millimeter). 
This  modulation  curve  is  shown,  for  a  typical  system,  in  Figure  3. 

Since  sine  wave  test  charts  do  not  occur  in  aerial  photographs, 
whereas  edges  do,  the  mathematical  relation  of  the  line  spread  to  the  den¬ 
sity  trace  of  an  image  of  an  edge  is,  in  practice,  used  to  obtain  the  modulation 

curve. 

In  general,  the  modulation  curve  is  a  function  of  orientation,  that 
is,  the  curve  shown  in  Figure  3  could  change,  if  the  sine  wave  charts  were 
rotated.  While  this  variation  occurs  far  off-axis  for  most  cameras,  for 
reason  of  simplicity  it  is  ignored. 

Two  parameters  were  derived  from  the  modulation  curve  for  this 
study.  These  were  first,  the  area  under  the  square  of  the  modulation  func¬ 
tion  called  the  "equivalent  passband,  "  (  A/g  ),  and  second,  the  "resolution,  " 

It  might  be  thought  that  "points"  or  "lines"  would  be  valuable  as 
known  object  functions;  however,  any  true  point  or  line  of  finite 
intensity  in  the  object  scene  will  be  undiscernable  in  the  degraded 
image. 
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TYPICAL  MOOUUTION  CURVE 


,  defined  as  that  frequency  at  which  the  transfer  curve  has  dropped  to 
25%  of  its  zero  frequency  value. 

Because  of  a  relationship  between  passbc.nd  and  resolution  (discussed 
more  fully  in  a  later  section),  the  numbers  derivable  from  an  edge  trace, 
which  will  be  used  in  describing  the  summary  measure,  will  be  resolution 
and  the  ratio  of  passband  to  resolution.  Thus,  it  will  be  sufficient  to  discuss 
only  the  measurement  and  meaning  of  passband  and  resolution. 

The  passband  and  resolution  numbers  are  obtained  in  the  following 

manner: 

(1)  A  sharp  edge  is  scanned  with  a  rectangular  aperture  in  a  micro¬ 
densitometer  and  the  density  trace  is  recorded.  (A  sharp  edge  is  one  which  is 
sharp  on  the  original  scene,  i.  e.,  edges  of  buildings,  etc.) 

(2)  The  edge  data  are  smoothed  to  reduce  noise  which  is  present  in 
the  input.  This  is  usually  accomplished  by  a  least  squares  fit  of  the  data 
points  to  a  polynomial.  * 

(3)  With  this  smoothed  data  for  the  edge  trace,  the  line  spread 
function,  Lix)  is  calculated  from  the  following  formula; 

L(X  )  =  DXz)  /O  ^  r  ( -  lo'^  )  (3) 


where  ^  Z»65)=  density  at  position  Z.,  t  -  Napierian  logarithmic 

base,  ancf  2?^  the  end  point  densities  of  the  edge  trace  and  y  the 

slope  of  the  photographic  H-D  curve.  Auxiliary  data  of  the  development  of 
the  photograph  furnishes  Y  for  this  calculation.  However,  calculations  are 
made  for  five  equally  spaced  about  the  "true  value"  to  check  the  depen¬ 
dence  of  the  computed  Llx)  on  Y  ,  In  all  calculations  2 fx)has  been  insen¬ 
sitive  to  the  value  of  Y  . 

(4)  The  passband*,  is  calculated  from: 


z 


oo 


(4) 


See  Appendix  II  for  all  mathematical  derivations  of  formulas  used 
in  this  section  and  for  a  description  of  the  data  smoothing  process. 
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(5) 


where  u>  is  the  angular  spatial  frequency.  (6)  In  this  program  the 
value  of  o0/2rr  for  which  r(cu/Zrr)  =  .  25  is  by  definition  the  resolution  of 


that  particular  scene. 

All  computations  from  steps  (2)  through  (6)  were  performed  on  an 
IBM  704  computer.  In  the  microdensitometer  traces,  the  slit  was  parallel 
to  the  edge  with  a  maximum  possible  error  of  one  degree. 

The  edges  were  scanned  first  with  an  effective  5 //t  x  380/^  slit 
and  then  by  an  effective  25.  4  x  380  slit.  If  there  were  no  changes 

in  the  shape  of  the  edge  traces,  the  larger  slit  size  was  used  because  of  the 
lower  grain  noise.  If  there  was  a  change  in  the  shape  of. the  edge  trace,  the 
smaller  aperture  trace  was  used  as  the  raw  data  in  the  analyses  of  the  pass. 


band  and  resolution. 


4.  Scale 

Scale  was  not  used  as  a  physical  variable,  however  it  deserves 
special  attention.  When  scale  is  discussed,  confusion  often  arises  since  m 
reality  two  different  scales  are  referred  to.  The  block  diagram  in  Figure  4 
illustrates  the  problem.  When  an  aerial  photograph  is  acquired,  the  image 
size  is  related  to  the  scene  by  the  "photographic  scale."  When  the  image 
is  to  be  interpreted,  the  image  is  normally  increased  in  size  for  viewing, 
either  by  photographic  enlargement  or  by  optical  magnifiers  (or  a  combina¬ 
tion).  This  latter  magnification  has  been  called  the  "viewing  scale"  for 
convenience. 

Considering  the  viewing  scale  first,  the  purpose  of  the  change  of 
size  is  to  present  the  image  to  the  eye  under  optimum  conditions.  Clearly, 
the  amount  of  magnification  which  is  useful  depends  on  both  the  target  to  be 
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examined  and  the  quality  of  the  original  image.  The  photointerpreter  is  the 
best  judge  of  optimum  conditions  for  each  case,  and  is  therefore  allowed  to 
vary  the  viewing  scale  by  selection  from  a  set  of  magnifiers. 

The  photographic  scale  sets  the  ratio  of  size  of  a  given  target  to 
the  dimensions  involved  in  the  physical  quality  measures.  Thus,  for  a  given 
quality,  the  photographic  scale  controls  the  target  types  which  might  be 
interpreted.  (Minneapolis -Honeywell  is  currently  studying  this  relation  in 
terms  of  ground  resolution.)  In  order  to  study  quality,  independent  of  the 
target  type  effect,  the  targets  were  selected  on  each  original  as  being  appro¬ 
priate  for  the  particular  photographic  scale.  After  selecting  photographs 
at  various  scales,  the  photographic  scales  were  held  constant  each  time  a 
given  original  was  presented. 
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B.  IMAGE  MODIFICATION 

A  number  of  methods  are  available  for  image  modifications.  Table  1 
lists  several  of  these  methods,  and  the  parameter  that  each  method  primarily 
modifies,  and  whether  the  method  enhances  or  degrades  that  parameter. 
Generally,  these  methods  are  not  completely  independent  (i.e.  ,  method  4 
also  changes  granularity  slightly)  and  proper  account  of  the  interrelation¬ 
ships  must  be  taken  to  obtain  specific  ranges  of  variables.  This  aspect  is 
discussed  in  more  detail  in  a  later  part  of  this  section. 

The  last  method.  Spatial  Filtering,  was  selected  for  the  modifica¬ 
tion  of  the  imagery  in  the  final  tests  and  is  discussed  in  detail  in  Appendix  III. 
The  process  of  spatial  filtering  consists  of  transforming  (by  optical  diffrac¬ 
tion)  a  photographic  image  on  a  transparency  into  its  spatial  frequency  com¬ 
ponents,  filtering  the  resulting  spectrum,  and  reconstructing  a  filtered 
image  by  a  second  transformation. 

The  passband  and  resolution  can  be  modified  by  spatial  filtering 
with  appropriate  filters.  Granularity  can  be  decreased  by  filtering  out  the 
higher  frequencies  which  are  not  needed  to  form  the  filtered  image,  and  can 
be  increased  by  imaging  the  modified  scene  onto  different  films  (2  in  Table 
Contrast  can  be  modified  by  two  means.  Increased  contrast  can  be  ob¬ 
tained  by  developing  the  image  film  to  a  high  gamma.  Decreased  contrast 
can  be  obtained  by  dividing  the  total  exposure  into  a  uniform  veiling  exposure, 
and  an  imagiiig  exposure. 
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TABLE  I  MODIFICATION  TECHNIQUES 


METHOD 

MODIFIES 

ENHANCE  OR 
DEGRADE 

1.  DEFOCUS 

r 

D 

2.  COPY  ON  GRAINY  FILM 

G,Cr) 

D 

3.  COPY  WITH  VEILING 
ILLUMINATION 

c 

D 

4.  COPY  ON  HIGH  GAMMA 
FILM 

c 

E 

5.  SPATIAL  FILTERING 

r,  G 

E  OR  D 
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C.  SELECTION  OF  VARIABLE  VALUES 

To  determine  the  functional  form  of  the  summary  measure,  as 
described  previously,  the  necessary  photointerpretive  tests  require  input 
photographs  in  which  the  physical  variables  cover  a  wide  range  of  values. 
This  desired  variation  of  physical  parameters  does  not  usually  occur  to  any 
large  extent  in  aerial  photography  taken  with  a  small  number  of  different 
cameras.  The  simplest  solution,  therefore,  is  to  start  with  a  limited  supply 
of  high  quality  aerial  photographs  and  artificially  vary  the  physical  para¬ 
meters  in  a  controlled  manner  to  generate  desired  ranges  of  variables. 

The  parameters  to  be  varied  are:  contrast,  grain,  passband, 
and  resolution.  However,  these  variables  are  not  completely  independent. 

In  order  to  perform  tests  with  samples  of  photographs  which  are  representa¬ 
tive  of  the  distribution  which  exists  in  real  photographs,  the  ranges  of  the 
individual  variables  and  their  correlations  must  be  taken  into  account. 

Contrast  is  relatively  independent  of  the  other  variables.  A 
correlation  with  scale  might  be  noted  since  higher  altitude  implies  lower 
contrast  and  generally  smaller  scale.  This  correlation  is  weakened  by  the 
use  of  various  focal  length  lenses  (which  decorrelates  altitude  and  scale) 
and  by  natural  weather  variations  (which  introduces  contrast  change  at  one 
altitude).  Therefore,  for  this  study,  contrast  will  be  assumed  to  be 
independent  of  other  variables.  The  range  of  contrast  is  taken  to  cover 
from  barely  detectable  contrast  to  as  high  as  normally  observed  in  aerial 
photographs.  This  limits  the  range  of  scene  contrast  (C)  to  approximately 
0.  05  to  2.  0. 

In  order  to  determine  representative  ranges  and  correlations  of 
the  passband,  resolution,  and  grain  variables,  a  number  of  lens-film  com¬ 
binations  were  considered  with  lenses  at  several  focus  settings  (coarsely 
simulating  normal  focus  errors  and  other  errors,  such  as  motion  or 
vibration).  The  resultant  values  are  plotted  in  Figure  5  with  theoretical 
limits  shown.  Although  the  cases  shown  are  by  no  means  complete,  ranges 
and  correlations  can  be  seen. 
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The  granularity  range  is  0.  01  to  0.  15  and  is  typified  by  several 
common  films.  The  correlation  with  passband  and  resolution  is  essentially 
one  of  setting  an  upper  limit  depending  on  .In  practice,  a  low  grain 

film  would  seldom  be  used  with  a  poor  camera  system,  thus  tending  to 
eliminate  low  passband  and  resolution  at  low  CT  .  This  cutoff  is  not  shown, 
but  was  included  in  sampling. 

The  relation  of  passband  (  )  to  resolution  (  R  )  shows  a  definite 

correlation.  It  is  possible  to  form  a  combination  of  these  variables  which 
provide  two  essentially  independent  variables.  The  resolution  can  be  inter¬ 
preted  as  a  scale  factor  for  the  system  modulation  curve  while  the  ratio  of 
passband  to  resolution  is  a  shape  factor,  which  should  be  independent  of  H  . 
Writing  the  value  of  /C  can  vary  in  the  range  0.25  to  0.  60. 

While  R  is  limited  only  by  current  lens  design,  a  practical  limit  can  be 
established  for  the  test  photographs.  Since  the  high  contrast  resolution  limit 
of  the  eye  is  the  order  of  5  to  10  lines/mm  at  normal  viewing  distance,  the 
interpreter  cannot  make  use  of  fine  detail  unless  magnification  is  provided. 
Thus,  the  upper  limit  of  the  resolution  used  is  chosen  after  the  maximum 
available  magnification  is  determined.  Up  to  12X  magnifiers  were  provided. 
To  cover  a  range  from  degradations  nearly  visible  by  eye  to  those  visible 
only  under  maximum  magnification,  the  range  of  R  (the  25%  point  of  the 
transfer  function)  was  selected  as  approximately  4-50  lines /mm.  This 
assumes  a  value  of  approximately  4  lines /mm  for  the  low  contrast  resolution 

limit  of  the  eye. 
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D.  SELECTION  OF  PHOTOGRAPHS 

All  photographs  were  selected  to  fulfill  the  criterion  of  being  areas 
q£  military  significance.  These  areas  include  industrial  facilities,  railroad 
and  storage  facilities,  ships  and  pier  facilities,  military  airfields,  radar 
stations  and  missile  complexes.  Scenes  with  various  scales  were  selected 
for  each  of  the  above  general  areas.  Because  of  a  shortage  of  appropriate 
scenes,  it  was  necessary  to  choose  a  number  of  classified  films. 

Ten  targets  were  chosen  for  each  original  scene  and  ground  truths 
established  by  the  concurrence  of  three  experienced  photointerpreters.  All 
targets  were  specific  objects  which  could  be  identified  in  the  unmodified 
photographs  but  which  became  progressively  unrecognizable  with  increasing 
degradations.  Checks  by  several  photo -analysts  indicated  that  all  targets 
were  identifiable  on  the  highest  quality  scenes,  none  were  identifiable  on  the 
poorest  quality  scenes,  and  on  an  average  over  all  the  scenes,  approximately 
fifty  percent  were  identifiable. 

Figure  6  is  part  of  an  enlargement  of  a  scene  used  in  the  deter¬ 
mination  test.  Directly  below  the  photograph  is  a  list  of  the  exact  target 
present. 
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ACTUAL  TARGETS 


1  AIRCRAFT 

2  MOBILE  CRANE 

3  SAWDUST  BURNER 
6  LUMBER  YARD 

9  FLAT  CAR  (S) 


Fig.  6  A  TYPICAL  DETERMINATION  SCENE  WITH  A  LIST  OF  THE  ACTUAL  TARGETS 
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III.  TEST  PROGRAMS 


This  section  contains  the  specific  details  and  results  of  two  experi¬ 
mental  tests.  The  first  test,  denoted  pretest,  was  smaller  than  the  second 
which  was  called  a  determination  test.  The  purpose  of  the  pretest  was  to 
refine  the  measuring  techniques  and  the  image  alterations,  and  to  obtain  an 
indication  of  the  dependence  of  the  summary  measure  on  the  photographic 
variables.  The  determination  test  was  to  determine  the  specific  form  of  the 
summary  measure. 

A.  PRETEST 

Ten  scenes  containing  military  targets  were  selected.  Each 
photograph  was  reproduced  with  ten  different  combinations  of  the  four  physical 
variables.  This  resulted  in  a  total  of  100  different  combinations  spaced  over 
the  range  of  each  of  the  four  variables.  The  ten  variations  for  each  of  the 
ten  scenes  were  picked  at  random  from  375  possible  combinations  (i.  e.  ,  5 
grains  x  5  contrasts  x  5  resolutions  x  3  passband-to-resolution  ratios). 

In  order  to  simulate  the  real  photographic  acquisition  process, 
original  9"  x  9"  positive  transparencies  were  used  and  the  modifications 
were  introduced  as  the  70  mm  negatives  were  produced.  By  contact  printing, 
two  positives  were  made  from  each  negative  transparency.  Special  overlays 
were  xeroxed  onto  the  positive  transparencies  producing  200  photographs, 

100  (with  a  coordinate  system  superimposed)  to  be  used  in  the  modified  free 
search  task  and  100  (each  with  ten  circled  targets)  to  be  used  in  the  identi¬ 
fication  task. 

This  section  gives  the  experimental  details  of  how  the  variations 
of  variables  for  the  100  photographs  were  produced,  the  specifics  of  the 
modified  free  search  task  and  the  identification  task,  and  an  evaluation  of 

the  pretest. 

1.  Photography 

The  modifications  were  produced  by  aperture  filtering  with  a 
Grover-View  camera  equipped  with  a  Graflex  lens.  The  apertures  used  to 
obtain  the  three  passbands  were;  a  small  aperture,  a  larger  aperture 
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and  an  annular  neutral  density  disc  inserted  in  a  large  aperture.  The  small 
aperture  reduced  the  aberrations  of  the  lens,  thus  a  sharp  point  spread  should 
be  produced  and  a  large  pas sband-to- resolution  ratio  should  be  obtained.  With 
the  larger  aperture,  a  sharp  point  spread  is  still  expected  due  to  the  center 
of  the  lens  but  the  aberrations  of  the  edges  of  the  lens  should  enlarge  the  tail 
of  the  point  spread;  hence  a  small  passband  to  resolution  ratio  should  be 
obtained.  The  annular  neutral  density  filter  should  produce  an  intermediate 
effect  on  the  point  spread;  therefore,  this  aperture  should  give  an  inter¬ 
mediate  passband  to  resolution  ratio. 

With  a  given  aperture,  resolution  was  controlled  by  defocussing 
the  lens.  To  maintain  as  much  reproducibility  as  possible,  a  sine  wave 
test  chart  was  photographed  at  various  distances  from  focus  with  the  three 
apertures.  From  subsequent  measurements,  graphs  were  obtained  of 
these  modulation  functions.  Resolution  as  a  function  of;  distance- 
out-of-focus  was  also  determined.  Note  that  although  defocussing  the  lens 
lowers  both  the  resolution  and  passband  considerably,  it  produces  only  a 
slight  change  in  the  passband  to  resolution  ratio. 

A  table  was  constructed  with  the  three  aperture  and  the  distances - 
out-of-focus  versus  resolution  information.  It  was  felt  that  from  this  table, 
five  different  resolution  values  could  be  obtained  for  each  of  the  high, 
medium  and  low  passband  to  resolution  ratios  described  above.  Because 
of  mechanical  instability  which  places  an  upper  limit  on  the  obtainable 
resolution  a  complete  range  of  variables  was  not  expectec^  but  it  was  felt 
that  the  range  of  resolution  and  passband  to  resolution  ratio  would  be  suf¬ 
ficient  for  the  purposes  of  the  pretest.  The  actual  ranges  produced  on  the 
pretest  were;  resolution,  5-20  lines/mm;  passband/ resolution,  0.35-0.80. 
The  actual  value  of  resolution  and  passband  to  resolution  ratio  were 
measured  for  each  image  in  the  manner  described  in  a  previous  section. 

To  achieve  sufficient  control  of  the  physical  parameters  for  the  Deter¬ 
mination  Test,  a  more  stable  apparatus  was  required. 

Five  levels  of  contrast  were  obtained  by  veiling-,  i.  e.  ,  a  uniform 
exposure  and  the  image  of  the  scene  were  superimposed  on  the  same  film. 
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This  veiling  exposure  was  theoretically  adjusted  in  relationship  to  the  total 
exposure  to  give  ratios  of  the  largest  density  difference  of  the  70  mm  copy 
to  the  maximum  density  difference  of  the  original  9"  x  9"  of  approximately 
1  0  0  75  0.50,  0.25  and  0.10.  In  the  actual  70  mm  negatives,  some 

adjustments  in  the  veiling  exposure  had  to  be  made  at  the  lower  contrast 
values  because  of  camera  flare.'^'  Measurements  following  the  previously 
described  procedure  revealed  that  the  range  of  contrast  values  were  0.50- 
0.  80.  This  veiling  procedure  to  lower  contrast  gave  a  good  range  of  values 
and  hence  was  satisfactory  for  use  in  the  determination  test  modification. 


Grain  was  controlled  by  using  five  different  films:  SO-278, 
Panatomic  X,  Plus  X,  Super  XX  and  Tri  X.  These  70  mm  negatives  were 
copied  with  a  contact  printer  to  create  positive  transpar^encies  on  SO-278. 

It  was  hoped  that  this  procedure  would  eliminate  any  bias  which  a  photo¬ 
interpreter  might  have  if  he  preferred  to  view  one  type  of  film  (due  to  color 
difference,  for  example).  The  granularities  of  each  of  the  positives  were 
measured  at  the  average  density  of  the  picture  and  not  all  at  a  fixed 
density  as  is  the  procedure  given  in  Kodak's  film  data  book.  The  calcu¬ 
lation  of  cr  followed  the  procedure  given  in  a,  previous  section.  Actual 
results  indicated  there  were  no  grouping  according  to  film  types  but  a 
rather  arbitrary  distribution  which  had  the  range  0.  025  -  0.  10. 

Analysis  of  the  granularity  data  and  subsequent  experiments 
showed  that  the  process  of  creating  a  positive  transparency  by  contact 
printing  from  a  modified  negative  tends  to  compress  the  granularity  scale 
and  creates  a  "nonwhite"  grain  noise  spatial  frequency  spectrum.  There¬ 
fore,  the  determination  test  image  modification  procedure  had  to  elimi¬ 
nate  the  contact  printing  process. 


2.  Test  Procedure 

Perhaps  the  most  realistic  photointerpretation  task  that  could 
have  been  used  is  free  search.  For  this  task,  the  interpreter  searches 

Camera  fl^also  places  an  upper  limit  on  the  obtainable  con¬ 
trast. 
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the  photograph  and  locates  and  identifies  any  targets  he  finds.  Unfortunately, 
since  the  total  number  of  responses  is  not  specified  in  any  instruction,  the 
interpreter  is  left  to  choose  for  himself  whether  or  not  to  respond  to  doubt¬ 
ful  targets.  This  creates  a  conflict  between  accuracy  and  completeness. 

To  increase  accuracy,  one  should  respond  only  when  he  is  certain,  while 
to  increase  completeness  one  should  respond  to  everything.  Such  a  set  of 
conflicting  criteria  would  result  in  an  increased  error  variance  and  could 
mask  the  true  effects  of  experimental  variables.  To  establish  a  definite 
accuracy  criterion,  two  tasks  were  chosen  both  involving  a  specification  of 
the  number  of  targets  on  each  photograph.  These  tasks  will  be  referred  to 
as  identification  and  modified  free  search. 

For  the  identification  task,  ten  targets  were  annotated  on  each 
photograph.  The  interpreter  was  required  to  identify  each  target,  selecting 
his  answers  from  a  key  containing  these  target  identifications  plus  10  targets 
which  did  not  occur  in  the  scene. 

In  the  modified  free  search  task,  each  interpreter  was  required  to 
locate  and  identify  the  same  targets  used  in  the  identification  task.  In 
other  words,  the  interpreters  searched  each  photograph  and  located  ten 
targets  appearing  on  a  target  key.  This  task  is  somewhat  more  realistic 
than  identification,  since  the  photographs  are  not  annotated,  but  the  task 
requires  more  time. 

For  each  task,  answer  sheets  were  provided  for  each  photograph. 
Table  2  presents  a  sample  answer  sheet  for  the  identification  task.  Answer 
sheets  for  the  modified  free  search  task  contained  the  same  material  and 
two  extra  columns  to  give  the  x  and  y  coordinate  of  the  targets.  In  addition 
to  reporting  the  information  in  the  answer  columns,  subjects  were  instructed 
to  record  their  confidence  in  each  target  identification.  Confidence  was 
defined  as  the  percentage  of  time  an  identification  with  a  given  rating  would 
be  correct,  such  that  identifications  rated  near  zero  would,  almost  never  be 
correct  and  identifications  rated  near  one  hundred  would  almost  always  be 

correct. 
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Inspection  of  Table  2  reveals  that  all  targets  in  the  key  consist  of 
specific  objects.  This  type  of  target  designation  was  necessary  to  limit  the 
number  of  correct  identifications  in  the  modified  search  task,  thus  main¬ 
taining  ten  identical  targets  in  both  pretest  tasks. 

Subjects  were  supplied  with  3,  8,  and  12-power  magnifiers. 

They  were  instructed  to  use  any  or  all  three  of  these  magnifiers  in  making 
their  identifications.  Subjects  were  not  given  any  photointerpreter  refer¬ 
ence  keys,  so  were  not  able  to  compare  images  with  standard  reference 

targets. 

The  modified  imagery  was  used  in  the  testing  of  nine  photointer¬ 
preters  from  Fort  Holabird,  seven  from  Fort  Meade  and  four  from 
USAPRO.  All  subjects  from  Fort  Meade  and  USAPRO  had  several  years 
experience  in  photointerpretation.  Those  from  Fort  Holabird  were  com¬ 
pleting  the  Army  photointerpretation  course  and  had  served  in  a  number  of 
previous  experiments.  The  photographs  were  randomly  assigned  to  the 
photointerpreters  with  the  restriction  that  an  interpreter  should  view  each 
of  the  ten  basic  scenes  only  once.  This  restriction  was  necessary  to  con¬ 
trol  learning  effects  which  would  result  from  repeated  viewing  of  a  single 

scene. 

Five  interpreters  from  Holabird,  four  from  Meade  and  one  from 
APRO  worked  on  the  identification  task.  Four  interpreters  from  Holabird, 
three  from  APRO  and  three  from  Meade  were  presented  with  the  modified 
free  search  task. 

3.  Results 

In  the  interpretation  tests,  the  primary  results  are  those  rele¬ 
vant  to  the  selection  of  a  photointerpreter  task  and  photointerpreter  test 
methods  for  the  determination  test.  The  accuracy  scores,  mean  confidence 
rating  and  physical  measures  for  the  pretest  are  tabulated  in  Appendix  IV. 

The  resolution  of  the  magnifiers  was  measured  as  17,  18,  17  lines/ 
mm  respectively  in  the  virtual  image.  Since  these  are  more  than 
three  times  the  resolution  of  the  normal  eye,  the  magnifiers 
should  cause  less  than  5%  error  in  the  net  resolution. 
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The  correlation  among  the  physical  variables  and  the  performance  measures 

are  given  in  Table  3.  The  elements  of  this  matrix,  ,  are  Pearson's 

product -moment  coefficients  of  correlation.  The  magnitude  of  r  gives  a 

measure  of  the  "strength"  of  correlation  between  two  variables.  (The 

values  of  r  range  from  -1  to  +1.  )  The  best  possible  prediction  of  one 

variable  (  u  )  from  a  known  value  of  another  variable  (  X*  )  is  obtained  from 
>!« 

the  equation; 

r  ay  (tC -Ic-)  +  y 

where  35  and  are  the  means  of  ^  and  y  ,  standard 

deviation  of  /  and  y  ,  and  r  is  the  corresponding  element  in  the  matrix  of 

Table  3. 

The  multiple  /?  is  given  only  for  the  accuracy  scores  of  the  identi¬ 
fication  and  search  task.  The  square  of  the  multiple  R  is  a.  measure  of  the 
variance  in  the  accuracy  scores  associated  with  or  determined  by  the  vari¬ 
ance  in  the  accuracy  scores  associated  with  or  determined  by  the  variance 
of  a  linear  combination  of  the  four  chosen  quality  parameters. 

The  low  multiple  R  for  the  linear  combination  of  physical  vari¬ 
ables,  plus  the  scatter  of  the  data  vh  ich  becomes  apparent  when  scatter- 
grams  are  plotted  indicate  that  further  effort  toward  deriving  a  preliminary 
summary  measure  was  not  warranted.  A  useful  summary  measure  should 
account  for  at  least  50%  of  the  variance,  implying  a  multiple  R  of  over  0.  7. 

The  correlation  between  the  average  search  score  and  average 
identification  accuracy  scores  across  scenes  is  0.86.  The  correlation 
between  search  and  identification  accuracy  scores  across  the  100  photo¬ 
graphs  is  0.  32. 

^  Guilford,  J.  P.  Fundamental  Statistics  in  Psychology  and 

Education  McGraw-Hill  Book  Co.  ,  Inc.  3rd  Edition 
p.  367  1956 
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TABLE  3 


CORRELATION  MATRIX  FOR  PRETESTS 


Correlations 


Mean 

Sigma 

Contrast 

Grain 

j 

1  Passband/ 

1  Resolution 

1  Resolution 

1 

i 

j  Confidence 

1 

i 

1  Multiple  R 

i 

1 

1 

I 

Contrast 

0.  35 

0.  17 

i 

0.  34 

-0.  24 

-0.  03 

Gxain 

0.  44 

0.  15 

0.  03 

-0.  09 

Passband/ 

Resolution 

0.59 

0.  09 

-0.  05 

Resolution 

9.  7 

5.  3 

Search; 

Accuracy 

3.  3 

1.7 

0.  41 

0.  01 

0.  12 

0.  09 

0.51 

0.  51 

Confidence 

37. 

21. 

0.  28 

0.  06 

0.  04 

0.  09 

Identification; 

Accuracy 

4.4 

2.  2 

0.  32 

0.  06 

0.  01 

0.  17 

0.  32 

0.  39 

Confidence 

42. 

21. 

0.25 

0.  03 

-0.  08 

0.  06 

4.  Discussion  of  Results 

While  the  higher  multiple  correlation  would  indicate  that  the  search 
task  might  be  more  appropriate  for  the  determination  tests,  it  was  also  ascer¬ 
tained  that  mean  time  per  response  for  that  task  was  more  than  double  that 
found  for  the  identification  task.  As  photointerpreter  time  was  severely 
limited,  a  determination  test  of  adequate  scope  could  only  be  carried  out  with 
the  identification  task.  Support  for  the  choice  of  the  more  feasible  task  was 
provided  by  the  high  correlation  found  between  the  two  tasks  on  the  pretests. 

The  choice  of  the  identification  task  also  permitted  modification  of 
the  target  descriptions  on  the  answer  sheets.  These  descriptions  had  been 
made  appropriate  to  both  of  the  pretest  tasks,  but  the  need  for  unique  targets 
in  the  modified  search  tasks  required  that  excessive  location  information 
(e.  g.  ,  "two  soldiers  near  a  truck")  be  provided.  Descriptions  of  this  type 
were  not  used  in  the  determination  tests. 
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The  use  of  target  keys  containing  only  20  targets  was  found  to  be 
another  limiting  factor  in  the  pretest.  As  10  of  the  20  targets  were  the 
correct  responses  and  others  could  be  readily  eliminated  from  consideration, 
there  was  more  opportunity  for  making  correct  guesses  than  was  desirable. 

It  was  therefore  decided  that  the  target  keys  for  the  determination  phase 
should  contain  a  larger  number  of  incorrect  alternatives  which  would  help 
to  prevent  the  occurrence  of  correct  responses  through  the  process  of 
elimination. 

During  the  pretests,  many  of  the  photointerpreter  subjects  indi¬ 
cated  a  desire  for  photograph  scale  information  and  target  reference  keys. 
The  determination  test  plans  therefore  included  the  provision  of  these 
data  and  materials,  which  were  not  provided  in  the  pretest. 

B.  DETERMINATION  TEST 

The  number  of  photographs  and  physical  variations  were  deter¬ 
mined  by  time  considerations  and  availability  of  photointerpreters.  It 
was  decided  to  make  one  thousand  photographs,  twenty-five  photointer¬ 
preters  each  viewing  forty  photographs.  The  quality  of  the  forty  scenes 
ranged  over  three  values  of  pas  sband -to- re  solution  ratios,  five  resolutions, 
five  contrasts  and  four  granularities.  From  these  300  possible  combinations 
of  variables,  250  combinations  were  selected  as  most  representative  of 
real  aerial  photographs.  Four  scenes  were  produced  with  each  combination 
of  parameters.  The  selection  of  scenes  for  each  combination  was  random 
but  restricted  such  that  each  of  the  40  scenes  was  reproduced  25  times. 
These  modified  photographs  were  used  in  interpretive  tests  and  the  results 
analyzed.  This  section  contains  the  image  modification  procedures,  a  des¬ 
cription  of  the  interpretive  tests,  and  the  results  of  the  determination  test. 

1.  Photography 

The  photographs  used  in  the  determination  test  were  obtained  by 
the  modification  process  illustrated  in  Figure  7.  The  forty  scenes,  having 
a  wide  range  of  militarily  significant  targets,  were  originally  in  the  form 
of  9”  X  9”  positive  transparencies,  and  they  were  reduced  to  approximately 
3”  X  3"  negatives.  These  negatives  were  secured  to  an  aluminum  frame 
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Fig.  7  PRODUCTION  OF  DEGRADED  SCENES  FOR  THE  DETERMINATION  TEST 
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which  codld  be  rapidly  inserted  into  a  spatial  filtering  apparatus  for  image 
modification.  (The  spatial  filtering  apparatus  is  described  in  Appendix  III.) 
The  scene  number  and  setup  number  (i.  e.  ,  film-contrast-resolution-pass- 
band/resolution  combination)  were  inscribed  in  a  scribecoat  drafting 
material  and  also  taped  to  the  aluminum  frames.  This  arrangement 
allowed  the  setup  number  and  scene  number  to  be  photographed  simul¬ 
taneously  with  the  modified  scene;  thus  eliminating  possible  confusion.  The 
spatial  frequency  filters  were  used  in  a  liquid  gate  in  the  filter  plane  of 
the  spatial  filtering  apparatus,  but  the  3"  x  3"  negative  transparencies 
were  used  without  a  liquid  gate.  The  absence  of  the  liquid  gate  caused  no 
noticeable  modification  in  the  resulting  positive  transparencies.  This  is 
expected  since  the  phase  variations  are  more  critical  at  the  filter  plane 
than  at  the  object  plane  for  filters  of  a  low  pass  nature  such  as  those  used 
on  this  project.  Streaks  and  dust  specks  were  a  problem  at  first  because 
their  image  overlapped  targets  but  were  found  to  appear  as  bright  spots  in 
a  high  pass  filtered  image  and  hence  could  be  located  and  eliminated  from 
the  system.  This  arrangement  of  liquid  gates  minimized  time  losses  in 


changing  scenes. 


With  a  filter  and  scene  in  the  spatial  filtering  apparatus,  a  3" 

X  3"  modified  positive  transparency  was  produced.  A  set  of  unfiltered 
photographs,  one  for  each  scene,  was  also  produced  on  Panatomic  X  film. 
These  unfiltered  photographs  were  used  to  produce  master  overlays  which 
had  ten  selected  targets  identified  by  Zip-a-tone  arrows  and  inked  numbers 


Twenty-five  xeroxed  copies  were  made  on  clear  acetate  from  each  master 
overlay  since  it  was  impractical  to  xerox  arrows  directly  onto  the  aerial 
films  because  of  natural  curl  of  the  films.  These  overlays  were  taped  to 
the  modified  3"  x  3"  positive  transparencies  after  the  arrows  were  matched 
with  the  targets.  These  positive  transparencies,  with  their  attached  over¬ 
lays,  were  framed  with  cardboard.  When  this  ensemble  was  viewed  with  a 
light  table  it  was  impossible  to  distinguish  between  the  four  types  of  film 
which  were  used  in  the  determination  test,  i.  e.  ,  it  eliminated  all  curl  and 
covered  color  variations  of  the  base  material.  This  arrangement  also 
circumvented  the  grain  problems  encountered  in  the  pretest  by  eliminating 


all  contact  printing  processes. 
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The  four  granularities  were  Controlled  by  using  four  different 
types  of  film:  SO-278,  Panatomic  X,  Plus  X  and  Tri  X.  The  range  of 
granularity  measurements  were  from  approximately  0.  03  to  0.  15  and  were 
obtained  in  the  following  manner. 

Approximately  20  scenes  for  each  of  the  four  films  types  used 
in  the  determination  test  were  randomly  selected  from  the  1000  photo¬ 
graphs  and  granularity  values  were  calculated  as  described  m  Section  II. 

A  plot  of  cr  as  a  function  of  the  average  density  at  which  cr  was  measured 
is  plotted  in  Figure  8.  The  graphs  of  Figure  8  clearly  reveal  that  the  four 
types  of  film  form  separate  groups.  It  was  assumed  that  the  curves  of 
Figure  8  correctly  express  the  granularity  measurements  of  the  1000 
photographs.  Hence,  the  granularity  values  for  the  particular  films  used 
in  the  determination  test  were  assumed  to  be  the  average  cr  in  Figure  8, 
evaluated  at  a  density  of  1.  2.  The  density  of  1.  2  was  selected  as  the 
average  density  of  the  thousand  photographs,  this  being  the  average 
density  of  the  randomly  selected  scenes  used  to  obtain  Figure  8.  Since 
all  film  of  a  given  type  was  exposed  and  developed  under  identical  con¬ 
ditions,  the  above  assumption  should  be  valid. 

The  values  of  cr'  for  granularity  are  somewhat  less  than  those 
published  by  Kodak  in  their  film  data  book  for  the  films  used,  when  the 
effect  of  scanning  aperture  size  is  taken  into  account.  Communications 
with  personnel  at  Kodak  and  Dr.  O.  H.  Schade  of  RCA  indicate  that  the 
film  data  book  values  of  cr  may  be  too  large,  accounting  for  this  dis¬ 
crepancy. 

The  five  contrast  levels  were  obtained  by  veiling  exposures  in  a 
manner  identical  to  the  procedure  described  in  the  pretest  section.  Actual 
contrast  values  for  each  of  the  thousand  photographs  were  in  the  range  of 

0.05  to  2.2. 

The  fifteen  combinations  of  resolution  and  pas  sband-to- re  so¬ 
lution  ratios  were  controlled  by  using  fifteen  spatial  frequency  filters.  Three 
master  filters  were  made  by  aperture  filtering.  The  passband-to-reso- 
lution  ratio  for  these  master  filters  were  adjusted  to  give  approximate 
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GRANULARITY  VS.  DENSITY 


values  of  0.  6,  0.  45,  and  0.  3.  The  five  levels  of  resolution  were  obtained 
by  photographing  the  master  filter  at  five  different  scales.  Following  the 
procedure  described  in  Section  II,  the  exact  values  of  the  resolution  and 
pa  ssband-to- re  solution  ratios  were  obtained  for  the  filters  and  are  shown 

in  Table  4. 

Fifty  film-filter  combinations  were  selected  from  a  group  of 
sixty  possibilities.  Ten  combinations  were  eliminated  by  comparing  the 
resolution  and  passband  values  with  the  theoretical  values  given  in  Figure 
5.  The  expected  resolutions  for  a  given  passband-to-re solution  ratio  were 
50,  35,  20,  10  and  5  lines /mm.  The  ten  film-filter  combinations  deemed 

lels  likely  to  be  obtained  in  real  photographs  are;  low  resolution  on  fine 
grain  film  and  high  resolutions  on  coarse  grain  films. 

Measured  values  of  passband-to-resolution  ratio  were  in  the 
range  0.  29  to  0.  55  while  resolution  values  were  in  the  range  of  4.  0  to 
18.0  lines /mm.  The  calculations  of  these  two  measures  are  described 

below. 

The  values  of  passband^e  and  resolution  R  were  obtained  by 
prediction  from  the  modification  process  and  checked  by  determining 
the  values  for  a  random  sample  of  the  modified  photographs  by  the  tech¬ 
nique  described  in  Section  II  and  AppendixII.  If  the  original  photographs 
were  of  high  quality  compared  to  the  desired  modified  images,  the  values 
of  f^e  and  R  for  a  given  modified  image  would  have  been  identical  to  those 
listed  in  Table  4  for  the  filter  used  in  the  particular  modification.  How¬ 
ever,  it  was  found  that  when  the  highest  quality  original  scenes  available 
were’  selected,  the  quality  was  far  from  high  enough  for  such  an  assumption. 
Therefore,  the  modulation  curve  of  the  original  had  to  be  taken  into 

account. 

One  or  more  edges  were  selected  on  each  original  scene,  and 
microdensitometer  scans  were  made  of  all  selected  edges.  The  procedure 
described  in  Appendix  II  was  used  to  extract  the  line  spread  functions  and 
modulation  functions  for  the  original  scenes.  The  raw  scan  data  were 
smoothed  by  a  least  squares  fit  to  a  seventh  degree  polynomial,  considering 
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TABLE  4  SPATIAL  FILTERS  USED  IN  DETERMINATION  TEST 
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errors  in  both  the  function  and  its  derivative  as  significant.  Since  it  is 
the  amplitude  transmission  function  whose  spectrum  is  modified  in  the  spatial 
filtering  system  (see  AppendixIII),  the  appropriate  relation  of  this  function 
to  the  measured  density  must  be  used  in  the  computation  of  the  modulation 
function.  From  the  definition  of  density  TZ?;  and  amplitude  transmission  (T^) 
one  has: 

D=  -  ZIo^Ta 


Comparing  this  equation  to 
in  Appendix  II: 


the  film  re  sponse  (Hurter-Driffield  curve)  used 


D  =  y  iog  S 


(8) 


it  can  be  seen  that  application  of  the  method  of  AppendixII  ,  assuming  a 
gamma  y  of  -2,  and  identifying  £  with  provides  the  desired  modulation 
curve.  This  procedure  was  used  to  arrive  at  the  and  R  values  to  be 
expected  for  each  original  modified  by  the  use  of  each  filter. 

Two  questions  arise  from  this  prediction  process;  first,  how 
valid  is  the  linear  theory  for  degradations  which  occur  in  several  steps, 
and  second,  how  well  do  the  predicted  values  agree  with  measurements  of 
the  modified  photographs?  To  answer  the  first  question,  one  can  examine 
the  problem  on  a  theoretical  or  an  experimental  basis.  Aerial  photo¬ 
graphic  negatives  were  contact  printed  to  produce  a  9"  x  9"  positive  trans¬ 
parency  which  was  then  reduced  to  a  3”  x  3”  negative  which  is  used  as  the 
"original"  for  modification.  If  the  primary  degradation  occurred  in  the 
contact  printing,  then  the  linear  theory  should  be  applicable.  If  this  is  not 
the  case,  then  as  the  linearity  approximation  fails,  different  edges  within 


A  fifth  degree  polynomial  was  also  used,  and  little  difference 
was  found. 

See  Appendix  II. 
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an  original  should  yield  different  modulation  functions  through  the  above 
procedure.*  Thus,  scanning  several  nearby  edges  within  the  format  of  one 
original  allows  this  aspect  to  be  checked.  Table  5  shows  the  R  values 
derived  for  several  edges  within  one  format.  It  can  be  seen  that  the  differ¬ 
ence  within  the  format  is  small  and  can  be  considered  to  be  well  within  the 
errors  inherent  in  the  noise  removal  process. 

TABLE  5  RESOLUTION  VALUES  FOR  DIFFERENT  EDGES 
IN  THE  SAME  SCENE 

Original  Scene 

lOA 
lOB 
IOC 
lOD 

To  answer  the  second  question,  approximately  50  modified  images 
were  selected  and  edges  scanned.  The  selection  was  made  so  as  to  sample 
cases  from  all  filters,  although  more  cases  of  high  and  low  values  were 

chosen  than  those  of  the  middle  class.  It  was  found  that  the  cases  in  which  the 
the  (A/e//?;  ratio  was  predicted  to  be  high,  good  agreement  was  found,  while 
in  cases  predicted  to  be  low  the  data  smoothing  process  plus  the  effect  of 
errors  in  the  determination  of  the  total  density  difference  across  the  edge 
(shown  in  the  numerical  example  in  Appendix  I  )  had  the  effect  of  raising  the 
computed  {NgjR)  ratio  as  well  as  causing  larger  fluctuations  in  the  deter¬ 
mination  of  R  values,  than  for  other  cases.  Because  of  the  large  errors  in 
the  computed  iN^jR)  values  the  most  reliable  test  of  the  prediction  pro¬ 
cess  is  the  value  of  R  . 

Figure  9  shows  the  correlation  of  measured  and  predicted 
values  for  a  number  of  modified  images.  Good  agreement  is  shown  by  the 
grouping  of  points  along  the  45”  line  (i.  e.  ,  R  measured  =  R  predicted)  with 

One  might  also  expect  a  difference  in  modulation  function  across  the  for¬ 
mat  of  the  original  due  to  the  variation  in  lens  quality  with  field  angle. 
However,  the  lens  effect  depends  only  on  position  and  varies  slowly  across 
the  format,  while  the  nonlinearity  depends  on  density  difference  and  aver¬ 
age  density  value  even  for  nearby  edges,  allowing  the  effects  to  be  sep¬ 
arated. 


Resolution  R  in  lines /mm 

10.  4 
12.  2 
12.  2 
12.  6 
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CORRELATION  OF  MEASURED  AND  PREDICTED  RESOLUTION 


about  a  tS  line/mm  error.*  In  a  number  of  the  cases  shown  as  O  ,  the 
measured  value  of  /?  was  obtained  from  the  determination  of  the  maximum 
of  the  density  gradient  as  described  in  Appendix  I  .  This  process  essen¬ 
tially  evaluates  the  maximum  of  the  line  spread  function,  whose  corre¬ 
lation  to  R  is  shown  for  a  number  of  computed  cases  in  Figure  10.  The 
empirical  relation,  also  apparent  in  the  theoretical  cases  in  Appendix  I, 


[pMl  max  (9) 

/.V5  /.^5AD 


The  only  check  made  on  the  predicted  (Ne/^i)  values  was  a  qualitative 
comparison  of  the  shape  of  the  density  trace  to  the  predicted  shape.  As 
shown  in  Appendix  I,  the  lower  the  (NjR)  value,  the  longer  the  -tails- 
of  the  density  trace  become.  Rating  high,  intermediate,  or  low  (N^IR) 
on  this  basis,  approximately  65%  of  the  sampled  modified  images  agree 
with  the  predicted  values.  Agreement  of  the  high  passband-to-resolution 
ratio  cases  with  computer  results,  and  checks  with  test  charts  lead  to 
the  conclusion  that  the  prediction  process  is  acceptable. 

2.  Test  Procedures 

The  determination  test  was  performed  by  18  students  and  one 
instructor  from  the  Air  Force  image  interpretation  school  at  Sheppard 
AFB.  The  test  was  designed  for  25  subjects,  but  only  19  were  available. 
Thus,  only  760  of  the  1000  modified  photographs  were  actually  used. 

Each  subject  was  provided  with  three  magnifiers,  a  standard 
PI  reference  key**  and  a  set  of  40  answer  sheets,  corresponding  to  the  40 
scenes.  The  magnifiers  were  the  3,  8,  and  12  powers  used  previously  on 


ene  39  accounts  for  4  of  the  greatest  errors,  and  may  indi- 
_  ..1 _ i _ 1  offontR  a  T-R  significant  in  this  one  scene. 


Consolidated  Photointerpreter  Key  AFM  200-28 
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Fig.  10  CORRELATION  OF  LINE  SPREAD  MAXIMUM  AND  RESOLUTION 


the  pretest.  Subjects  were  instructed  to  use  any  or  all  of  the  three  magni¬ 
fiers  as  desired.  Each  answer  sheet  consisted  of  a  target  test  containing 
10  correct  and  40  incorrect  target  alternatives,  a  column  for  recording 
the  identifications  of  the  ten  indicated  targets,  and  a  column  for  recording 
confidence  in  the  identification.  The  photographic  scale  was  also  pro¬ 
vided  for  each  scene.  A  sample  answer  sheet  is  present  in  Table  6. 

The  subjects  were  instructed  to  identify  all  of  the  ten  indicated 
targets  and  to  record  their  confidence  in  the  accuracy  of  each  identifi¬ 
cation.  Confidence  was  defined  in  the  pretest. 
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TABLE  6  SAMPLE  ANSWER  SHEET  FOR  DETERMINATION  TEST 

TIME  time 


3. 


Results 


The  raw  scores  for  the  19  Interpreters  and  the  values  of  the  four 
physical  variables  for  each  of  the  1000  modified  photographs  are  tabulated  m 

Appendix  V, 

Histograms  of  the  distribution  of  interpreter  scores  are  shown  in 
Figure  19  for  each  original  scene  and  Figure  20  for  each  interpreter 
(See  Appendix  V).  The  mean  score  for  each  interpreter  is  shown  on  the 
figure.  The  mean  score  for  all  interpreters  is  only  2.2,  and  as  can  be  seen 
from  the  histograms,  nearly  all  scores  are  grouped  closely  at  the  low  en 
of  the  scale.  The  only  exception  is  the  instructor  whose  mean  score  o 
3.  67  is  almost  double  the  average  score. 

Discussions  with  Instructors  at  S.A.F.B.  revealed;  a)  The 
training  course  at  S.A.  F.B.  consists  mostly  of  the  basic  theory  necessary 
for  photointerpretation  with  less  emphasis  on  actual  target  >dent;t;cat;on, 
and  b)  all  students  completing  the  training  course  must  have  exp 
at  an  operational  installation  for  one  year  before  they  can  obtain  a 

rating. 

The  student  subjects  also  indicated  (in  writing  and  in  conver¬ 
sations  with  them);  a)  their  experience  had  consisted  mainly  of  work  with 

stereographic  materials,  b)  in  many  cases,  they  lackedfamlliarity  with 

particular  target  classes  and  with  certain  targets  within  each  class,  an 
c)  the  nomenclature  was  foreign.  The  greatest  aiiiicu  ty 
with  missile  sites, and  army  facilities  and  equipment. 

Responses  from  the  participating  instructor  indicated  he  was 
generally  familiar  with  the  nomenclature  and  although  a  range  of  physical 
quality  was  sampled  in  the  photographs,  the  majority  of  the  scenes  w  ic 
he  observed  were  of  lower  quality  than  those  normally  used  in  photoint 

pretation. 

In  general,  the  discussions  at  S.A.  F.B.  suggested  that  the  18 
participating  students  did  not  have  the  level  of  experience  necessary  for 
the  determination  tests. 
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Prior  to  any  analysis  with  the  data,  answers  were  rescored  on  a 
less  specific  level,  i.  e.  instead  of  considering  the  specific  targets  (e.  g. 

POL  tank)  the  answers  were  scored  under  a  general  classification  (e.  g. 
presence  of  storage  tanks).  This  procedure  raised  the  level  of  the  scores 
but  did  not  improve  the  distributions  because  most  subjects  now  generally 
were  always  correct  on  the  easy  targets  but  still  incorrect  on  the  difficult 
or  unfamiliar  ones.  After  this  attempt  at  rescoring,  analyses  were 
carried  out  to  determine  if  any  meaningful  results  could  be  obtained  from 
the  raw  data  tabulated  in  Appendix  V. 

Product  moment  correlations  were  computed  between  all  variables 
as  in  the  pretest.  The  correlation  matrix  for  the  determination  test  is 
given  in  Table  7.  The  correlations  between  physical  variables  indicate 
that  the  desired  relations  were  achieved  reasonably  well,  the  two 
strongest  correlations  being  granularity  and  passband-to-resolution  ratio 
with  resolution.  These  correlations  were  expected  because  high  gram  films 
were  not  used  at  high  resolutions  and  because  the  limited  quality  of  avail¬ 
able  originals  made  it  difficult  to  achieve  low  passband-to-resolution  ratios 
at  high  resolution.  Low  correlations  were  found  between  the  accuracy 
scores  with  the  individual  variables  and  a  low  multiple  R  was  found  between 
a,ccuracy  and  a  linear  combination  of  the  physical  variables.  The 
multiple  R  =  0.  36  indicates  that  only  13  percent  (i.  e.  R^)  of  the  variance 
in  the  accuracy  scores  is  accounted  for  by  the  physical  variables. 

To  obtain  at  least  a  rough  indication  of  the  terms  which  should 
be  considered  in  further  summary  measure  studies,  and  in  fact  to  deter¬ 
mine  whether  a  summary  measure  can  be  expected  to  exist,  the  data 
were  divided  into  groups  having  approximately  equal  physical  measure 
values.  Contrast  and  resolution  were  divided  as  low,  medium  and  high, 
while  passband-to-resolution  ratio  and  granularity  were  divided  simply 
as  low  or  high.  The  accuracy  scores  achieved  on  photographs  with 
approximately  constant  physical  quality  are  plotted  in  Figure  11.  While 
in  a  few  cases  peaks  occur  which  suggest  a  quality  associated  with  those 
categories,  in  most  cases  the  effect  of  extraneous  variables  is  clearly 

seen. 
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table  7  CORRELATION  MATRIX  FOR  THE  DETERMINATION  TEST 

Correlations 


Contrast 

Grain 

Passband/ 

Resolution 

Resolution 

Accuracy 

Confidence 

Multiple  R 


Mean  Sigma 


0.  52 
0.  08 


0.  33 
0.  04 


0.45  0.  06 

10.6  4.1 

2.2  1.7 

53.  22. 
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4. 


Discussion  of  Results 


Direct  statistical  procedures  exist  lor  the  derivation  of  a  sum¬ 
mary  measure'from  the  numbers  in  Table  7,  However,  the  inadequacy  of 
the  photointerpreter  sample  preclude  the  derivation  of  a  valid  summary 
measure.  A  most  convincing  argument  to  illustrate  this  point  is  revealed 
in  Figure  11,  1.  e.  ,  the  accuracy  score  distributions  for  constant  physical 
Quality.  If  the  distributions  for  constant  quality  were  sharply  peaked,  or 
spread  only  slightly  about  scores,  then  a  summary  measure  could  be  derive  . 
However,  the  distribution  scores  in  Figure  11  are  clearly  not  peaked  about 
any  scores.  Hence,  a  valid  summary  measure  cannot  be  derived  from  t  ese 
data.  Nevertheless,  attempts  were  made  to  glean  as  much  information  as 
possible  from  the  data. 

From  the  cases  where  some  prediction  is  possible  and  from 
scatterplots  of  the  same  data,  it  appears  that  contrast  becomes 
at  scene  contrasts  below  approximately  0.  4.  indicating  perhaps  a  threshol  mg 
effect  for  the  targets  of  military  significance.  Additional  scatterplots  were 
made  in  an  attempt  to  elicit  further  results,  but  no  definite  conclusions 

This  would  be  in  th^rm 

-«eVetr  Henry  Holt  and  Co. 
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ACCURACY  SCORE 


Fig.  II  (CONTINUED)  ACCURACY  SCORE  DISTRIBUTION 
FOR  CONSTANT  PHYSICAL  QUALITY 
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could  be  drawn.  However,  during  the  examination  of  the  data  the  authors 
formed  several  opinions  which  may  guide  further  work.  Passband  is  pro¬ 
bably  more  important  than  resolution,  that  is,  edge  sharpness  appears  to  be 
of  greater  importance  than  separation  of  fine  detail  in  target  identification. 
Product  terms  of  contrast  and  grain  with  resolution  (or,  more  likely,  pass- 
band)  apparently  contribute  important  terms  to  the  summary  measure.  The 
product  terms  are  to  be  expected  since  the  first  is  essentially  a  measure  of 
the  information  available  in  a  given  noise  term  that  occurs  in  Selwyn's 
equation  for  resolution.*  It  must  be  emphasized,  however,  that  the  above 
predictions  are  based  on  weak  indications  and  are  therefore  conjectures 

at  this  time. 

Possible  reasons  for  the  failure  of  this  test  to  yield  a  valid  summary 
measure  are: 

a)  Non-physical  variables,  e.  g.  ,  specific  scene  content  may  . 

account  for  some  of  the  variance  in  performance.  This  would 
imply  that  quantative  indices  of  such  variable  must  be  obtained 
and  included  in  future  research  programs.  The  existence  of  a 
summary  measure  for  a  given  scene  type  and  given  class  of 
target  should  definitely  be  investigated  in  future  programs. 

b)  The  discrepancies  between  the  level  of  performance  required 
on  the  test  and  the  level  of  subject  capability  may  account  for 
some  of  the  variance  in  performance.  Pretesting  of  the  sub¬ 
jects  who  will  perform  in  a  determination  test  should  be  able 
to  remedy  such  a  situation.  It  should  be  pointed  out  that  if  a 
lack  of  experience  with  aerial  photographs  exists  on  the  part  of 
those  subjects  being  tested,  then  their  results  cannot  be  genera¬ 
lized  to  obtain  meaningful  results  for  the  operational  case. 

Another  possibility  is  that  the  ranges  of  physical  variables  are  not 
representative  of  those  found  in  operational  photointerpretation.  Since  the 
correlation  coefficients  depend  on  the  range  of  variables,  the  results  are 
influenced  by  any  shortcomings  in  the  achievement  of  correct  ranges. 
Although  this  is  true  in  general,  it  is  felt  that  this  possibility  has  been 
ruled  out  since  careful  checks  indicate  that  the  ranges  of  variables  used  in 
the  determination  test  are  representative  of  those  found  in  operational 
photo  interpretation  tasks. 


Selwyn,  E.  W.  H.  The  Photogr; 
Sensors  Photographic  Journal 


The  Photographic  and  Visual  Resolving  Power  of 
Dhic  Journal  Vol.  88B  (1948)  pp.  46-57 
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IV.  CONCLUSIONS  AND  RECOMMENDATIONS 


It  i.  not  possible  to  derive  a  entnmary  measnre  o£  image  quality 

n  •  data  because  of  difficulties  encountered  during  the 

from  the  experimental  data  oecaus  v  ^q-awn  and 

teate  However,  a  number  of  valuable  concluetona  can  be  drawn  and 
aeveml  recommendations  made  with  respect  to  test  procedures,  .mage 
modification  techniques  and  physical  quality  measurements. 

The  primary  difficulty  encountered  during  the  naain  test  was  the 
difference  between  the  level  of  capability 

available  and  the  level  of  performance  required  on  the  test.  Hence 
future  test  programs,  effort  should  be  devoted  to  the  des.gn  of  a  t  ^ 
which  could  be  used  either  as  an  interpreter  select.on  system 
control  measure  of  performance. 

Although  there  is  insufficient  evidence  to  determine  whether  the 
targets  and  questions  selected  for  thetests  would  have  provided  a  good 
range  of  difficulty  for  experienced  photointerpreters,  nevertheless,  no 

except  eLenslve  pretesting  exists  at  present  for  .beUng  a^g.ven 

target  or  question  about  a  target  as  easy,  moderate,  or  i 

m^ication  technique  should  be  studied  as  it  would  be  a  valuable  a.d 
in  selecting  photographs  and  questions  for  future  tests. 

A  set  of  1000  modified  photographs  with  controlled  and  mea- 

a  n  cal  parameters  is  now  available.  The  use  of  veiling  exposures 

omo  vanous  fHms  to  co-ol  gr— 
are  good  modification  techniques.  Spatial  filtermg  provides  a  s«a  ght 
forward  control  method  for  modifying  the  transfer  function.  " 
printing  from  modified  images  created  significant  changes  m  the  g 
L™  ectrum.  As  this  change  has  an  unknown  effect  on  the  .nterpre  er 
performance,  the  modified  images  should  be  used  only  as  ortgina 
further  study  of  the  copying  effects  are  conducted. 

Techniques  were  developed  for  extracting  quality  parameters 

f  an  aerial  scene  without  recourse  to  test  charts.  The  measure  o 

sre  coirs.  Which  was  defined  is  relatively  easy  to  extract  and  corre¬ 
lates  with  the  visual  impression  of  scene  contrast.  The  -1“=  » 


granularity  measured  differ  from  those  reported  by  Kodak,  but  are  in 
closer  agreement  with  other  measurements  made  by  RCA.  Further 
study  of  the  slightly  different  techniques  used  in  the  three  cases  should 
resolve  this  problem. 

Although  the  extraction  of  the  modulation  function  from  an 
edge  scan  was  successful,  several  refinements  require  further  study. 
Among  these  refinements  is  the  study  of  smoothing  computations  to 
remove  noise  since  no  method  was  found  which  always  provided  a 
satisfactory  result.  Further,  in  the  case  of  images  in  which  the  pass- 
band  to  resolution  ratio  is  small,  the  edge  trace  has  long  tails  which 
make  the  determination  of  the  total  density  difference  difficult.  Finally, 
when  image  degradations  have  occurred  during  several  generations  of 
copying,  nonlinear  effects  are  introduced  for  which  no  convenient 
formulation  has  been  generated. 

Thus,  although  a  summary  measure  has  not  been  derived, 
valuable  advances  in  image  quality  evaluation  have  been  made  in  the 
areas  of  testing,  modifying  images  and  measuring  physical  parameters. 
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Appendix  I 

PHOTOGRAPHIC  PARAMETERS 


This  appendix  considers  a  number  of  measures  which  are  commonly 
used  to  describe  a  photograph  and  to  relate  these  measures  to  the  parameters 
discussed  in  the  main  body  of  the  report.  Measures  considered  are  coarsely 
divided  into  categories  of  granularity  (noise),  contrast,  resolution,  and 

sharpness. 


Granularity 

The  granularity  or  noise  considered  in  this  report  is  that  which 
causes  density  fluctuations  in  an  area  in  which  the  image  exposure  is  a  con¬ 
stant  The  granularity  is  usually  described  either  by  a  power  density  spectrum 
or  simply  by  a  root  mean  square  fluctuation.  The  calculation  of  the  root  mean 
square  fluctuation  used  in  this  report  is  described,  and  its  relation  to  the 
power  density  spectrum  is  shown  both  in  general  and  for  a  special  case  o 

interest. 

The  noise  (N)  can  be  described  in  terms  of  density  (D)  as; 

where  the  density  is  measured  by  scanning  with  a  microdensitometer,  and  O 
is  the  computed  average  value.  The  mean  square  fluctuation  is  measured  by: 


/iX/2 


^  -X/2 

Where  the  average  is  taken  in  only  one  direction  since  the  function  is  random, 
X  is  the  length  of  the  scan  used  to  measure  N.  The  same  value  would  be 
measured  if  the  average  is  taken  over  both  dimensions  as: 

-X/2 
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Now.  by  Parseval's  theorem,'*'  the  integral  of  the  square  of  a  function  is 
just  the  integral  of  the  power  density  spectrum  over  spatial  frequencies 
(u>jc,jCOtj)  or: 


where  Pf^  is  the  measured  power  density  (power/unit  spatial  frequency). 
Equation  13  is  the  general  relation  of  root  mean  square  fluctuation  to  the 
power  density  spectrum.  Since  the  granularity  is  normally  measured  by  scan¬ 
ning  with  a  circular  aperture,  the  measured  power  spectrum  is  the  product  of 
the  true  grain  spatial  frequency  power  spectrum  and  the  square  of  the  aperture 
modulation  fuaictlon.  ‘'.The  modulation  function  (  T  )  of  the  aperture  (of  radius 
R  )  is: 


ncu) 


(JJR 


(14) 


where  is  the  first  order  Bessel  Function. 

If  it  is  assumed  that  the  spectrum  of  the  grain  is  actually  a  constant 
(  )  to  some  cutoff  frequency(  CO^  )  and  zero  beyond,  then  from  13  and 

14: 

which  can  be  integrated  and  reduced  to: 

<1*1 

where  A®  TTR^G^  is  a  constant  proportional  to  Kf  and  Jq  is  the  zero  order 
Bessel  Function.  For  the  case  where  the  aperture  is  a  reasonable  size  and 

Helstrom,  C.  W.  Statistical  Theory  of  Signal  Detection  Pergammon 

Press  1960  p.  340 

**  It  is  assumed  that  the  sample  length  /  is  large  compared  to  ! 
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the  cutoff  frequency  is  high,  Equation  16  reduces  to  the  expression  quoted 
in  the  body  of  the  report  for  aperture  dependence: 

The  value  of  o'  also  depends  upon  the  average  density.  The  relation 


takes  the  form: 


cr=K 


where  /<  is  a  proportionality  constant  depending  on  film  type,  etc.  ,  and  n  is 
a  number  normally  in  the  range  from  0.  3  to  0.  5. 


Contrast 

The  definition  of  "scene  contrast"  is  considerably  more  difficult  than 
"target  contrast.  "  Although  the  exact  functional  form  used  for  target  contrast 
varies  from  one  investigation  to  another,  all  definitions  are  simply  related. 

For  a  target  image  of  density  Dj  on  a  background  density  .  the  target 

contrast  is  expressed  by  various  investigators  as: 

a.  Dq  ~  Dj 

b.  Antilog 

c.  [Antilog  (D0  -£?r)]~  ^ 

d.  j[Antilog(On-Or)]-']/ /[AnWog  (do  -  Dr  \  ■ 

The  extension  of  these  definitions  to  a  scene  contrast  definition  is  not  obvious. 
One  possibility  is  to  simply  consider  the  target  and  background  densities  to 
become  the  maximum  and  minimum  density  values  in  the  over-all  image 
carman  and  Brown-*  suggest  a  range  including  less  than  100%  of  the  observed 
points,  such  as  99%,  since  a  specular  reflection  from  the  sun  might  provide  a 

Carman  &  Brown  Brightness  of  Fine  Detail  in  Ground  Photography 
JOSA  49  p.  6Z9  June  1959 
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gingle  excessively  bright  point.  Other  work,  by  Cnrmen  and.  Carruthers 
has  provided  frequency  distributions  of  occurrence  of  various  brightness 
differences  of  nearby  points  in  aerial  scenes.  Such  a  concept  could  lead  to 
a  functional  description  of  contrast,  from  which  several  parameters  might 
be  extracted. 

Since  a  single  number,  rather  than  a  function,  was  desired  as  a 
measure  of  contrast,  the  frequency  distribution  concept  was  not  used  in  this 
program.  However,  the  occurrence  of  density  differences  in  nearby  points 
appears  to  be  a  logical  extension  of  the  concept  of  target  contrast.  Thus, 
the  definition  of  scene  contrast  used  in  this  report  incorporated  the  concept 
of  nearby  points.  To  avoid  the  measurement  of  a  frequency  distribution, 
simply  the  largest  monotonic  density  changes  in  a  scan  were  measured,  and 
the  six  largest  were  averaged  to  avoid  single  specular  reflections,  as  noted 
above. 


Resolution 

The  word  "resolution"  is  probably  the  most  used,  and  most  misused, 
word  related  to  image  quaUty.  Loosely,  resolution  measures  the  ability  to 
reproduce  fine  detail.  To  become  any  more  quantitative,  the  target  used  and 
the  criterion  for  resolution  must  both  be  defined  with  reasonable  care.  Laxity 
in  these  definitions  causes  confusion. 


Resolution  targets  fall  generally  into  the  class  of  repetitive  patterns 
of  light  and  dark  bars  or  pairs  of  points.  The  repetitive  bars  can  have  various 
length- to -width  ratios,  sine  or  square  wave  intensity  patterns  and  various  con¬ 
trasts.  The  pairs  of  points  are  usually  considered  as  infinite  contrast  (i.  e.  , 
white  points  on  a  perfectly  black  background).  The  resolution  criterion  is 
either  a  visual  limit  or  some  definite  density  variation  when  the  pattern  is 
scanned  by  a  given  midrodensitometer  aperture. 


Visual  resolution  tends  to  mix  the  effects  of  modulation  function  and 
granularity.  For  the  case  of  sine  wave  targets  and  visual  resolution  limit,  it 
is  possible^  to  relate  the  target  contrast  (C)  ,  the  system  modulation  transfer 


*.v 

rfi 


Carman 
JOSA  41 
Selwyn, 
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&  Carruthers  Brightness  of  Fine  Detail  in  Air  Photography 
p,  305  March  1951 

E  W  H  The  Photographic  and  Visual  Resolving  Power  of 

'  Photographic  Journal  Vol.  88B  (1948)  pp.  46-57 
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function  (T)  .  and  the  granularity  (&)  to  predict  resolution.  The  resolution 
limit  ('/?)  is  predicted  as: 


rCr(R)  = 


(19) 


where  Y  is  the  slope  of  the  film  H'D  curve.  C  is  the  target  contrast 
defined  as  the  ratio  of  peak  brightnes s  to  average  brightness  minus  one.  (5 
is  the  constant  given  by  Equation  17.  .  The  constant  K  is  essentially  the 
minimum  detectable  signal-to-noise  ratio  and  is  approximately  equal  to  6. 

The  equation  applies,  with  less  precision,  to  square  wave  bar  charts. 

Equation  19  describes  the  noise-limited  case.  When  the  value  of 
the  right  hand  side  becomes  small,  the  contrast  threshold  of  the  eye  becomes 
significant  and  Equation  1 9  ceases  to  be  valid.  Although  the  transition 
region  is  in  doubt,  when  the  grain  is  small  enough  that  the  contrast  threshold 
of  the  eye  becomes  the  limiting  factor,  the  resolution  can  be  predicted  by: 


YCz(r)  =  0,0¥ 


(20) 


A  special  case  of  this  equation  was  used  in  the  body  of  the  report  as  the 
measure  of  resolution.  For  a  unit  gamma  copy  of  a  test  chart  whose  bright¬ 
ness  ratio  is  1 .  4: 1 .  then  /=1.  CM1.4-1.2)/i.2=  1/6.  and  Equation 

20  reduces  to  T(R)  =  0.24.  Thus,  the  25%  point  of  the  modulation  function 
is  a  measure  of  visual  resolution  for  the  case  of  a  sine  wave  test  chart  (and 
approximately  for  a  bar  chart)  with  a  brightness  ratio  of  1.4:1  copied  on  a  near  y 
grainless  film.  Obviously,  this  particular  case  is  only  one  of  the  many  pos¬ 
sible  selections  of  target  contrast,  each  of  which  would  correspond  to  picking 
a  different  point  along  the  modulation  transfer  curve. 


Sharpness 

Under  the  category  ot  eharpneee  are  included  thoee  parameterB  which 
relate  only  to  the  modulation  function  and  poBBibly  to  nonlinearities  in  the 
aystem.  Thua,  theae  meaauree  are  independent  of  contraat  and  granularity. 
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In  the  sense  of  arbitrarily  choosing  a  point  on  the  modulation  transfer  function, 
the  contrast  limited  resolutions  just  considered  could  be  grouped  with  the 
sharpness  definitions. 

A  measure  of  sharpness  suggested  in  1902  is  called  the  "Strehl  Intensity" 
orthe"Strehl  Definition".  Assume  the  system  point  spread  is  described  by  the 
intensity  distribution  The  Strehl  Intensity  is  then  defined  as  the  maxi¬ 
mum  of  normalized  by  dividing  by  the  maximum  ^fei^Jwould  obtain  in 

a  diffraction  limited  system.  While  this  normalization  aids  in  measuring  the 
effect  of  lens  aberrations,  simple  normalization  to  unit  energy  would  also 
provide  a  sharpness  measure. 

Closely  related  to  the  Strehl  Intensity  is  the  concept  of  maximum  edge 
gradient.  If  the  density  trace  across  an  edge  has  been  converted  to  exposure 
by  use  of  the  Density-log  Exposure  curve,  then  the  edge  gradient  is  related  to 
the  line  spread  function  (L)  by: 


ofX 


{21.) 


where  AC  is  a  normalization  constant  which  depends  on  the  size  of  the  original 
step  (  AC  =  1  for  a  unit  step),  and  ^(x.)  is  the  edge  intensity  function.  Thus, 
the  maximum  edge  gradient  normalized  to  a  unit  step  is  identically  the  maxi¬ 
mum  of  the  line  spread  and  is  therefore  a  one -dimensional  equivalent  of  the 
Strehl  Intensity.  It  should  be  noted  that  on  occasion  the  unnormalized  edge 
gradient  is  used  as  a  measure  of  sharpness,  but  clearly  such  a  function  is  not 
unique  for  a  complete  scene.  For  the  case  of  relatively  low  contrast  edges  in 
the  original  scene,  the  equation  relating  the  line  spread  {L)  to  the  density 
trace  (O)  across  an  edge  is  derived  in  Appendix  II  and  is: 


0(20 
D'(k  )  10  ^ 


'  7(loq.^e)(  10 


(22) 


i.  G*  >  JJ P('X-i  ^ 

This  relation  is  derived  in  Appendix  II 
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(23) 


and  can  be  expanded  conveniently  as: 

rr  d(*)-Do  .  .  .11 


Utc)  - 


where  and  Dq  are  the  density  values  far  from  the  edge  and 

_  y(lc^  e)  ~  If  the  edge  was  a  low  contrast  in  the  origi¬ 
nal  scene,  then  (D^  small  compared  to  unity  and  Equation  23  can 

be  approximated  as: 


(24) 


where  AP-Dy-^a  •  In  that  case,  the  maximum  density  gradient  normalized 

to  a  unit  density  difference  is  the  maximum  of  the  line  spread. 

Another  class  of  sharpness  measures  which  is  related  to  the  above 
is  the  measurement  of  an  average  density  gradient  over  some  percentage  of 
the  total  density  difference  across  the  edge.  Frequently,  the  inverse  of  this 
measure  is  labeled  as  -edge  width.  "  These  measures  are  convenient  because 
such  a  quantity  can  be  calculated  by  determining  the  value  oi  AD  ,  the  total 
density  change,  and  then  locating  the  points  where  the  density  trace  reaches 
stated  percentages  of  the  total.  When  the  percentages  are  close  together  near 
the  center  of  the  curve,  the  inverse  of  the  edge  width  so  defined  is  directly  pro¬ 
portional  to  the  maximum  density  gradient.  Although  a  correlation  will  still 
be  evident,  choosing  points  further  from  the  center  of  the  curve  will  allow 
varying  line  spread  shapes  to  create  a  range  of  values  for  the  ratio  of  the 
maximum  density  gradient  to  the  reciprocal  edge  width. 

Workers  at  Kodak  have  found  that  a  measure  of  mean  square 
density  gradient  tends  to  correlate  with  the  visual  impression  of  sharpness. 
This  measure,  called  "acutance*',  is  defined  as. 

Jy^  {o'CTcSf  cLy,  (25) 


Perrin,  F.  H.  JSMPTE  Vol.  29  p.  151  I960 
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Where  the  symbols  are  the  same  as  in  previous  equations  and  and  are 
the  "ends"  of  the  edge.  While  the  exact  definition  of  X,  and  X^  is  somewhat 
arbitrary,  the  frequently  used  value  is  that  where  the  density  gradient  is  0.  005 
density  units /micron. 

It  is  interesting  to  note  the  relation  between  the  acutance,  defined  by 
Equation  25  and  Schade's  equivalent  passband,  used  as  the  sharpness 
parameter  in  this  report.  The  passband  (  A'e  )  as  shown  in  Appendix  II  can 
be  computed  from: 


.-hoo 


e 


(26) 


-OO 


For  the  same  approximations  as  used  in  Equation  23  this  equation  reduces 
to: 


/Ve  = 


(27) 


The  integrals  in  Equation^  25  and  2.7  are  essentially  equal,  since  D'(t6) 
is  negligible  beyond  the  range  of  to  X^  •  Therefore, 

A  =  ^^AOA/eCXz  -X/)~'  (28) 

Since:  (1)  the  X,  and  X^  values  are  the  points  where  \D(x)\  =  0.005, 

(2)  L(X)  is  given  approximately  by  Equation  24  and  (3)  L(x)  is  constant 
for  all  edges  in  a  given  area  of  a  scene;  then  for  edges  of  differing  AD  , 

(1)  Ng  is  a  constant  and  (2)  A  increases  with  AD  for  any  line  spread  shape 
in  which  the  tail  of  L(x)  decreases  faster  than  (K/X*). 
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In  order  to  illustrate  the  various  sharpness  measurements  and  to 
indicate  possible  sources  of  error,  two  numerical  examples  are  presented 
below.  These  are  an  exponential  and  a  Gaussian  modulation  function: 


Z.  (^) 


where  is  measured  in  lines /millimeter.  The  curves  are  plotted  in  Figure 

12  and  it  can  be  seen  that  both  curves  cross  0.  25  at  =  27.8  lines/mm 

millimeter.  The  corresponding  line  spread  functions  can  be  calculated  to  be: 


,01567L^) 


u(x)  =  6  e 


where  is  measured  in  microns.  These  curves  are  plotted  in  Figure  U. 

A  particular  case  was  assumed,  namely  an  original  edge  in  which  the 
exposure  changes  by  a  factor  of  2,  copied  by  systems  with  each  of  the  above 
line  spreads  onto  a  film  developed  to  a  gamma  of  2.  The  density  traces  are 
shown  in  Figure  14  .  Table  8.  summarizes  the  various  sharpness  measures: 
the  resolution,  R  ,  {25%  point  of  Z  ),  the  passband,  Nq  ,  their  ratio,  the 
value  of  the  maximum  of  the  line  spread,  the  normalized  maximum 

density  gradient,  maximum,  the  reciprocal  edge  width,  , 

between  the  10%  and  90%  points  in  density,  and  the  acutance,  A  •  The  two 
measures  which  depend  on  (  A/J  )  are  also  given  (and  subscripted  PRAC) 
where  (  )  has  been  taken  as  the  density  difference  between  the  endpoints 

shown  in  Figure  14  rather  than  the  theoretical  limits.  Obviously,  similar 
errors  would  be  contained  in  the  determination  of  L(X)  ^  and  therefore,  in 
A/e  and  >?,  if  the  procedure  outlined  in  Appendix  II  was  used  to  determine 

l.(x)  from 

What  is  perhaps  of  greatest  interest  in  Table  8  is  the  good  correla¬ 
tion  between  the  maximum  value  of  the  line  spread  and  the  resolution  (25% 
point).  This  constant  ratio,  also  observed  in  the  values  measured  on  imagery, 
is  about  1.45.  For  cases  where  the  normalized  density  gradient  is  a  good 
approximation  to  KX),  this  provides  a  quick  approximation  to  R  .  The 
reciprocal  edge  width  tends  to  vary  in  the  manner  of  passband  or  acutance, 
although  the  measurement  becomes  sensitive  to  the  choice  of  curv 

which  has  a  low  passband  to  resolution  ratio. 
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TABLE  8  VALUES  OF  QUALITY  MEASURES 


MEASURE 

EXPONENTIAL  TRANSFER  FUNCTION 

GAUSSIAN  TRANSFER  FUNCTION 

R 

27.8  mm“* 

27.8  mm"* 

Ne 

10.0  pnm"* 

1 4. 8  mm"  * 

Ne/R 

0.36 

0.53 

max 

40.0  mm“* 

41.8  mm"* 

39.0  nmi“* 

41.5  mm"* 

max.prac. 

45.3  mm"* 

41.5  mm"* 

T|0'' 

16.9  mm"* 

40.0  mm"* 

[^10  J  prac. 

31.3  mm”* 

40.0  mm"* 

A 

352.  mm"^ 

490.  mm"^ 
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Appendix  II 

DETERMINATION  OF  RESOLUTION  AND  EQUIVALENT  PASSBAND 


It  is  the  purpose  of  this  appendix  to  show  how  the  resolution,  and  the 
ratio  of  passband  to  resolution  occur  in  the  mathematical  description  of  an 
image  on  a  photographic  transparency,  and  how  they  are  extracted  from  the 
density  trace  across  an  edge. 

The  basis  of  the  imaging  process  is  the  image  of  a  point.  In  a 
linear  process, the  exposure  E.  transparency  can  be  related  to  any 
object  function  by  superimposing  the  images  of  the  individiial  object 

points ; 


7^00 

cCt:* citj'  (31) 

-flo 


where  P(x,yi^)\s  the  "point  spread"  fimction  and  is  assumed  to  be  real. 

The  Fourier  transform  of  the  point  spread  function  is  called  the  "two- 
dimensional  optical  transfer  function.  "  The  one-dimensional  case  is  of 
primary  interest  here  and  therefore  with  B  ^  B  (Xi)  Equation  31  becomes: 


cx> 

B  (yc)  =  J'b  ( 7C') 

—  oo 


f—  oo  — t 

^ P  dy  'J  cL%' 

-oo 


(32) 


The  "line  spread  function,  "  L(X^  is  defined  as  the  cross  section  of  the 
image  of  a  line  object,  and  so  with  B  fx)  =  (S  (X^)  the  line  spread  is: 

oo 

L(%)=  J  (33) 

-oo 


and  Equation  32  is  now  written: 

CO 

E(yc)^  j  B  (xi')  L  (tC-t:')  oL%' 

-CO 


(34) 
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The  Fourier  transform  oi  L  (ic)  is  the  "one -dimensional  optical  transfer - 
function,  " 


V((U})=  J  L(x) 

•“CO 


Two  comments  are  in  order  regarding  the  above  integrals.  First 
normalization  constants  have  been  ignored,  but  the  common  definitions  of 
L(tL)  and  ffaj)  are  such  that; 


t'(o)  =  J'  l-(7C)  =  i 


(36) 


Second,  it  should  be  noticed  that  in  the  general  case  P(X>(j)  is  not  rota- 
tionally  symmetric,  and  therefore  the  line  spread  depends  upon  the  orientation 
of  the  line.  However,  only  symmetric  point  spreads  are  of  concern  in  this 
study  and  therefore  either  /  (x)  or  ^Co)  is  sufficient  to  determine  uniquely 
the  image  of  a  given  object  function. 

Of  the  four  parameters  selected  to  describe  image  quality,  resolu¬ 
tion  and  equivalent  passband  are  determined  from  the  modulation  curve. 

Since  'V' (<^)  is  complex  in  general,  it  can  be  expressed  as: 


T(cd)  -  (co)  e 


'0  (<d) 


(37) 


where  is  a  real,  positive  function  called  the  "modulation  transfer 

function."-'  For  the  purpose  of  this  study,  "resolution,  "  ^  ,  is  defined  as 

the  lowest  frequency  for  which  is  equal  to  0.  Z5.  The  equivalent  pass • 

band,  ,  has  been  defined  by  Schade; 


/V,=  217 


(38) 


w 


Schade  O.  H.  A  New  System  of  Measuring  and  Specifying  Image 

Definition  National  Bureau  of  Standards,  Circular  526 
April  29,  1954 
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It  is  quickly  seen  from  the  above  equations  that  passband  and  resolu¬ 
tion  can  be  determined  if  the  exposure.  (or  equivalently  the  density) 

is  measured  in  the  image  for  a  known  object  function  B  Since  the 

object,  is  not  available,  a  knowledge  of  B  must  be  obtained  by  interpre¬ 

tation.  The  most  frequently  occurring  object  function  which  can  easily  be 
recognized  in  the  image  is  a  sharp  transition  (i.  e.,  an  edge).  The  mathe¬ 
matical  expression  of  a  sharp  edge  may  be  written: 


B(x)  — 


oc^  ( X  <0) 
(■X>0) 


where  and  are  unknown  constants.  Using  this  object  function  in 

Equation  34,  the  image  function  E  (x)  becomes: 

O  CO 

E(x)^  X^JlCx-x')  aCx' 

-CO  ® 

which,  by  a  change  of  variables  ^  and  the  use  of  the  condi¬ 

tion  of  Equation  36  ,  can  be  written; 

7^ 

J  L(to)  dB:,  (4L) 


Differentiating  Equation  41,  the  line  spread  function  can  be  written; 


Ux)  = 


^7,  1 


In  order  to  relate  L  to  the  densitometer  trace  of  an  edge  on  a 

photographic  transparency,  a  digression  is  necessary  to  discuss  the  terms 
and  properties  of  film  transparencies.  After  the  exposed  film  is  developed, 
the  film  image  is  expressed  by  either  the  "transmission"  which  is  the 

ratio  of  transmitted  to  incident  light  intensity,  or  "density"  (D)  which  is: 

-E 

-'4^  T 
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The  empirical  relation  between  the  film  density  and  the  exposure  is  given  by 
the  Hurter-Duffield  curve.  Figure  15  is  a  schematic  representation  of  a 
typical  H-D  curve  for  a  photographic  emulsion.  Exposures  are  assumed  to 
lie  within  the  linear  portion  of  the  curve.  The  slope  of  the  linear  part  is 
the  film  ''gamma''  (  2^  )  and  its  value  depends  upon  how  the  film  was 
developed.  Therefore,  the  relation  between  D  and  £  within  the  useful 
exposure  range  is: 

D  =  '^  E  -t  k  (44) 


It  is  density  that  is  to  be  related  to  the  line  spread  function  since  this  is  the 
quantity  recorded  in  the  scanning  process.  Eliminating  the  exposure  func¬ 
tion  between  Equations  42  and  44,  LM  can  be  written: 

P(^x)  -k 

,  d'(X)  !0  ^ 

L(z)=  - ; - : -  («) 


Assuming  A  approaches  O  when  —  i-  =»,  li".iting  densities 


can  be  defined: 


dU) 


A  (X  •=°) 


Incorporating  these  definitions,  and  again  using  the  normalization  condition 
on  /.  (^^6^  (Equation  36  Equation  45  can  be  written. 

P  Dp 
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Using  Equation  47,  the  calculation  of  resolution  and  equivalent  passband 
was  carried  out  by  an  IBM  704  computer  in  the  following  manner. 

1.  Sampling  of  density  trace  of  edge  (microdensitometer  output) 

2.  Smoothing  to  eliminate  fluctuations  due  to  grain  noise.  Pre¬ 

sently,  smoothing  is  done  by  a  least  squares  fit  of  a  7th  degree 
polynomial  to  the  sampled  density  trace.  The  7th  degree  was 
selected  as  a  compromise  between  poor  fitting  of  lesser  degree 
polynomials,  and  the  tendency  of  higher  degree  polynomials 
to  follow  grain  noise.  Since  L{%)  depends  explicitly  on  D  (^) 
as  well  as  0(x>),  the  error  minimized  in  the  least  squares  pro¬ 
cess  includes  the  error  (approximate]'/  weighted)  in  fitting 
0'(')£)  to  the  derivative  of  the  polynomial. 

3.  Calculation  of  /('>{)  using  the  smoothed  trace  with  the  proper 

value  of  y  assumed  known,  and  the  values  of  Oq  and  D/ 

determined  by  the  end  points  at  the  smoothed  trace. 

❖ 

4.  Calculation  of  equivalent  passband 


J  J 


(48) 


5.  Calculation  of  rjuj)  ,  from  this  the  resolution  (  R  )  is 

determined  as  the  lowest  frequency  at  which  Z,(aj/Zri)becomes 

0.25. 

The  discussion  up  to  this  point  has  considered  an  iniage  that 
results  from  only  one  degrading  process;  that  is,  the  image  transparency 
is  a  first  generation  photograph.  Some  comments  are  in  order  regarding 
an  image  resulting  from  two  or  more  steps,  each  of  which  may  or  may 
not  degrade  the  image.  Consider  a  two-step  process  where  the  original 
scene  is  imaged  onto  a  negative  transparency  and  then  copies  onto  a 
second  negative  transparency.  Three  cases  are  possible; 


Aereement  with  Equation  38  can  be  shown  by  Parseval's  theorm. 
Helstrom,  C.  W.  Statistical  Theory  of  Signal  Detection 
Pergammon  Press  p.  340  I960 
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1.  The  primary  degradation  occura  only  In  the  second  step 

2.  Th  jprlmary  degradation  occur,  only  In  the  first  step 

3.  Brin  steps  contribute  significantly  to  the  net  degradation 

to  th..  f.rst  case,  no  problem,  arl.e  and  the  preceding  mathe¬ 
matics  are  apul-.cable  when  It  1.  understood  that  the  proper  value  of  X 
Is  just  that  ol  the  second  transparency.  The  mathematics  still  hold  for 
the  second  car  a,  if  the  va  lue  of  is. 


/  -  yf  rz 


(49) 


where  y,  ;  ^id  are  the  values  for  the  first  and  second  transparencies. 
In  the  last  iases  where  both  steps  degrade  but  neither  is  dominant,  a 
simpio<:^volution  integral  (Equation  31  )  usually  cannot  be  written  and 
thi^ifore  there  is  in  gene  ral  no  point  spread  function  that  will  describe 
the  two-step  process.  The  calculation  of  L(.%\  for  example,  will  yield  a 
function  that  would  depend  upon  which  edge  in  the  format  was  scanned. 
There  are  special  cases,  however,  for  which  line  spread  functions  do 
exist  and  two  of  these  are, 

1,  Low  contrast  object  scene 

2.  Yf  =  rz  =  ' 

For  each  of  the  above  cases,  the  effective  line  spread  function  ] 

is  the  convolution  of  the  line  spread  functions  for  each  step; 


^  OO 


(50) 
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Appendix  HI 
SPATIAL  FILTERING 


A  two-dimensional  pattern,  such  as  a  photograph,  consisted  of  a 
surface  distribution  of  light  and  dark  areas  which  can  be  expressed  as  a  two- 
dimensional  function  f  of  coordinates  on  the  surface.  The  breakdown 

of  -P  (%,Lj)  into  its  spatial  frequency  distribution  is  given  by  its  two- 

dimensional  Fourier  transform. 

“  CO 

The  parameters  ^^and  (or  to  be  precise: 

are  the  frequencies  in  the  ^  and  ^  directions  and  have  units  of  eye  es 
per  unit  distance  as  measured  in  the  plane  of  The  transform 

function  is  just  a  measure  of  the  contribution  of  each  of  the  frequencies, 
corresponding  to  a  particular  phase  and  orientation,  to  the  pattern  f 
In  general,  both  and  CJ^ )  are  complex  and  it  will  be 

convenient  to  refer  to  their  intensities.  The  intensity  of  a  function  f  (tC,  C^) 
is  the  square  of  its  absolute  value  \P  (  .  The  intensity  of  the 

complex  spectral  amplitude  \<^  referred  to  as  the  power 

spectrum. 


Optical  Technique 

The  basis  for  being  able  to  carry  out  this  transform  optically,  is 
that  under  certain  conditions  the  diffraction  pattern  of  a  two-dimensional 
object  is  itself  the  two-dimensional  Fourier  transform  of  the  object.  T 
procedure  of  spatial  filtering  is  to  generate  optically  the  Fourier  transform 
of  a  picture  by  means  of  diffraction,  modify  the  frequency  spectrum,  by 
appropriate  filtering,  and  then  obtain  an  altered  image  of  the  original  object. 
A  system  for  performing  these  operations  is  shown  in  Figure  16 
consists  of  a  monochromatic  point  source  illuminating  a  film  transparency 
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(object)  which  is  the  picture  to  be  analyzed.  As  the  wave  passes  through 
the  transparency,  diffraction  waves  are  generated  which  form  a  pattern  in 
the  filter  plane  after  passing  through  the  object  lens.  The  filtered  diffrac¬ 
tion  waves  then  recombine  in  the  last  plane  to  form  an  image  of  the  original 
transparency.  A  complete  analysis  of  this  system  is  given  in  a  previous  _ 
report,  *  and  some  of  the  results  are  quoted  here. 

1.  The  plane  representing  the  Fourier  transform  of  the  object 
function,  is  the  plane  containing  the  image  of  the  point  source 
formed  by  the  lens. 

2.  The  plane  representing  the  reconstructed  image  of  the  object 
is  not  shifted  as  a  result  of  the  filtering  operation  and  hence 
remains  conjugate  to  the  plane  containing  the  object  trans¬ 
parency. 

3.  The  functions  y)  and  g  (oj^  ,  of  Equation  51 

within  a  phase  factor,  are  the  complex  amplitude  functions 
representing  the  amplitude  and  phase  of  the  light  in  the  object 
and  filter  planes  respectively. 


Example  of  Spectral  Analysis 

As  a  demonstration  of  hoW  the  frequency  components  of  an  object 
are  distributed  in  the  filter  plane,  a  halftone  transparency  and  its  spatial 

frequency  spectrum  are  given  in  Figure  17  *  As  shown  in  Figure  17 

the  halftone  is  periodic  and  therefore  has  a  spectral  distribution  that  is 
discrete  rather  than  continuous.  This  is  shown  in  the  second  photograph 
(Figure  17b  ),  where  the  bright  central  spot  corresponds  to  zero  frequency. 
The  orientation  of  the  components  of  the  frequency  spectrum  of  the  halftone 

can  be  understood  by  considering  Figures  17.C  and  17d  .  Figure  17c 

is  a  schematic  of  the  halftone  of  Figure  17a  ,  and  the  three  lowest  periodi¬ 

cities  are  indicated  along  with  their  wavelengths.  The  double  headed  arrows 


Roetling,  P.G.,  and  Hammill,  H.B.  Study  of  Spatial  Filtering 

CAL  Report  No. 


Koetiing,  x-.vj.  ,  — ,  —  —  •  ~  . 

by  Optical  Diffraction  for  Pattern  Recognition 
VE-1522-G-1  13  February  1962 
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(a)  MAGNIFIED  HALFTONE 


(b)  HALFTONE  POWER  SPECTRUM 


M 


(c)  HALFTONE  SHOWING  PERIODICITIES 


(d) 


POWER  SPECTRUM  SHOWING  ORIENTATION 
OF  FREQUENCY  COMPONENTS 


Fig.  17  ANALYSIS  OF  HALFTONE-TRANSPARENCY 
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indicate  the  orientation  of  the  periodicity,  and  when  compared  with  the 
spectrum  of  Figure  I7d  ,  it  is  seen  that  the  frequency  components  have 
the  same  orientation.  Since  the  periodicities  of  the  halftone  are  not  sine 
waves,  harmonic  frequencies  of  each  fundamental  are  included  in  the 
spectrum. 

Spatial  Filtering  Apparatus 

The  spatial  filtering  equipment,  installed  in  a  controlled  environ¬ 
ment  laboratory  (Figure  18.  )  uses  a  mercury  light  source  filtered  to 

pass  the  4360  A  line  which  illuminates  a  pin  hole  to  obtain  a  point  source. 
The  collimator  and  objective  lenses,  both  of  5”  aperture,  allow  up  to 
approximately  3"  x  3"  transparencies  to  be  used.  The  frequency  cut-off 
of  the  system  is  about  100  lines /mm.  Both  the  image  transparency  and 
spatial  filter  are  normally  immersed  in  liquid  gates  in  order  to  eliminate 
phase  effects  due  to  optical  path  differences  through  the  film,  and  the 
holder  for  the  filter  is  rotatable. 
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Appendix  IV  PRETEST  DATA 


This  appendix  is  a  tabulation  of  the  data  pertinent  to  the  pretest, 
giving  (1)  the  values  of  the  quaUty  parameters  for  each  scene,  (2)  the  task 
in  which  the  scene  was  used  and  (3)  the  interpreters  scores  for  accuracy 
and  confidence  in  identifying  the  objects. 


79 


VE-1667-G-1 


TABLE  9 
PRETEST  DATA 


CONTRAST 

GRAIN 

PASS8AND 

RESOLUTION 

RESOLUTION 

NUM8ER 

RIGHT 

0.  16 

0.019 

0.52 

(mm-l ) 

07.3 

2 

0.23 

0.039 

0.80 

17.0 

2 

0.08 

0.031 

0.57 

II. 0 

3 

0.43 

0.  031 

0.53 

04.5 

2 

0.20 

0.030 

0.80 

II. 0 

4 

0.28 

0.051 

0.51 

06.4 

1 

0.29 

0.022 

0.50 

13.0 

7 

0.77 

0.037 

0.61 

07.8 

5 

0.65 

0.029 

0.50 

06.7 

6 

0.55 

0.090 

0.54 

03.5 

3 

0.36 

0.042 

0.61 

09.2 

5 

0.  35 

0.026 

0.52 

1 1.0 

4 

0.  18 

0.036 

0.56 

II. 0 

8 

0.33 

0.034 

0.62 

II. 0 

5 

0.65 

0.044 

0.45 

06.2 

9 

0.  14 

0.067 

0.52 

13.0 

3 

0.35 

0.062 

0.80 

13.0 

7 

0.72 

0.053 

0.55 

05.4 

8 

0.44 

0.069 

0.60 

09.7 

10 

0.  19 

0.034 

0.80 

07.8 

5 

0.06 

0.016 

0.76 

14.0 

2 

0.41 

0.034 

0.74 

10.0 

7 

0.35 

0.050 

0.57 

19.0 

8 

0.73 

0.053 

0.50 

13.0 

3 

0.21 

0.057 

0.80 

II. 0 

5 

0.23 

0.038 

0.50 

06.6 

4 

0.31 

0.039 

0.61 

13.0 

4 

0.41 

0.027 

0.54 

03.5 

5 

0.  18 

0.054 

0.57 

03. 1 

3 

0.27 

0.039 

0.47 

15.0 

5 

0.38 

0.051 

0.59 

II. 0 

5 

0.65 

0.055 

0.68 

15.0 

7 

0.  12 

0.029 

0.64 

07.8 

3 

0.58 

0.044 

0.64 

II. 0 

4 

0.44 

0.059 

0.59 

06.7 

5 

0.  17 

0.053 

0.57 

05.4 

1 

0.25 

0.048 

0.47 

25.0 

5 

MEAN 

CONFIDENCE 

TASK 

P.  1. 

ORDER 

NO. 

SCENE 

NO. 

( In 

39 

1 

1 

1 

5331 

29 

1 

1 

2 

4784 

43 

1 

1 

3 

4914 

32 

1 

1 

4 

4861 

43 

1 

1 

5 

5394 

26 

1 

1 

6 

4492 

45 

1 

1 

7 

4463 

59 

1 

1 

8 

5386 

42 

1 

1 

9 

4888 

25 

1 

1 

10 

4750 

38 

1  2 

1 

478  4 

28 

1  2 

2 

5394 

18 

1  2 

3 

4463 

28 

1  2 

4 

4914 

75 

1  2 

5 

4888 

10 

1  2 

6 

4492 

46 

1  2 

7 

5331 

44 

1  2 

8 

4861 

88 

1  2 

9 

5386 

28 

1  2 

10 

4750 

00 

1 

3 

1 

4492 

30 

1 

3 

2 

4914 

40 

1 

3 

3 

5386 

25 

1 

3 

4 

4784 

30 

1 

3 

5 

5331 

12 

1 

3 

6 

4888 

20 

1 

3 

7 

5394 

32 

1 

3 

8 

4861 

12 

1 

3 

9 

4750 

48 

1 

3 

10 

4463 

36 

1 

4 

1 

5331 

25 

1 

4 

2 

4750 

02 

1 

4 

3 

4914 

32 

1 

4 

4 

4861 

18 

1 

4 

5 

5386 

03 

1 

4 

6 

4784 

06 

1 

4 

7 

5394 
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CONTRAST 


0.25 

0.35 

0.21 


0.67 
0.1^9 
0.55 
0.  18 
0.20 
0.31 
0.55 
0.31 
0.  10 
0.57 


0.20 
0.34 
0.  19 
0.34 
0.54 
0.29 
0.41 
0.62 
0. 12 
0. 17 


0.  II 
0.  17 
0.40 
0.50 
0.38 
0.61 
0.38 
0.41 
0.48 
0.29 


0.44 

0.21 

0.25 

0.41 

0.64 

0.38 


TABLE  9  (Continued) 


PASSBAND  \ 

NUMBER 

GRAIN  1 

RESOLUTION 

RESOLUTION 

RIGHT 

; 

(mni-l ) 

0.047 

0.66 

13.0 

6 

0.052 

0.55 

05.0 

6 

0.035 

0.59 

22.0 

6 

0.052 

0.50 

07.5 

6 

0.045 

0.60 

14.0 

10 

0.034 

0.63 

14.0 

5 

0.036 

0.50 

12.0 

1 

0.036 

0.62 

04.6 

2 

0.056 

0.62 

05.2 

4 

0.079 

0.64 

05.5 

3 

0.029 

0.62 

05. 1 

4 

0.065 

0.68 

05.6 

2 

0.062 

0.51 

03.9 

5 

0.039 

0.69 

12.0 

2 

0.051 

0.56 

06.0 

3 

0.038 

0.61 

16.0 

3 

0.050 

0.78 

05.7 

4 

0.054 

0.62 

18.0 

3 

0.042 

0.44 

08.6 

1 

0.041 

0.55 

17.0 

5 

0.050 

0.60 

06.7 

2 

0.039 

0.53 

12.0 

3 

0.037 

0.54 

17.0 

3 

0.040 

0.51 

09.2 

0 

0.051 

0.58 

1 1.0 

6 

0.085 

0.53 

12.0 

4 

0.042 

0.55 

22.0 

8 

0.042 

0.63 

06.7 

5 

0.055 

0.53 

07.2 

5 

0.064 

0.52 

07.8 

7 

0.067 

0.60 

04.8 

3 

0.023 

0.56 

07.3 

2 

0.038 

0.60 

04.2 

1 

0.051 

0.62 

10.4 

7 

0.037 

0.66 

08.9 

6 

0.032 

0.60 

II. 0 

7 

0.035 

0.62 

07.3 

2 

0.055 

0.45 

07.0 

4 

0.035 

0.53 

14.0 

7 

80 


MEAN 

ORDER 

SCENE 

CONFIDENCE  TASK 

P.  1. 

NO. 

NO. 

(In  %) 

38  1 

4 

8 

4888 

29  1 

4 

9 

4492 

58  1 

4 

10 

4463 

34 

1  5 

1 

4888 

59 

1  5 

2 

5386 

48 

1  5 

3 

4914 

14 

1  5 

4 

4492 

07 

1  5 

5 

4463 

15 

1  5 

6 

5394 

35 

1  5 

7 

5331 

30 

1  5 

8 

4861 

16 

1  5 

9 

4784 

19 

1  5 

10 

4750 

62 

1  6 

1 

4463 

56 

1  6 

2 

5331 

64 

1  6 

3 

4784 

54 

1  6 

4 

4888 

68 

1  6 

5 

4861 

59 

1  6 

6 

4492 

53 

1  6 

7 

5386 

71 

1  6 

8 

4750 

36 

1  6 

9 

5394 

73 

1  6 

10 

4914 

56 

1  7 

1 

4784 

57 

1  7 

2 

4888 

60 

1  7 

3 

5331 

64 

1  7 

4 

5394 

68 

1  7 

5 

4750 

63 

1  7 

6 

5386 

48 

1  7 

7 

4463 

49 

1  7 

8 

4914 

49 

1  7 

9 

4492 

46 

1  7 

10 

4861 

34 

1 

8 

1 

4888 

32 

1 

8 

2 

5386 

48 

1 

8 

3 

5331 

30 

1 

8 

4 

4784 

25 

1 

8 

5 

4914 

60 

1 

8 

6 

4463 
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TABLE  9  (Continued) 


/  PASSBAND  1 

NUMBER 

MEAN 

ORDER 

SCENE 

CONTRAST 

GRAIN 

RESOLUTION 

RESOLUTION 

RIGHT 

CONFIDENCE  TASK 

P.  1. 

NO. 

NO. 

\  / 

( mm- 1 ) 

(in 

0.39 

0.040 

0.48 

40.0 

2 

23  1 

8 

7 

4861 

0.65 

0.046 

0.56 

4.7 

7 

37  1 

8 

8 

5394 

0.26 

0.035 

0.64 

10.0 

8 

84  1 

8 

9 

4750 

0. 12 

0.026 

0.60 

05.2 

3 

18  1 

8 

10 

4492 

0.44 

0.072 

0.59 

10.0 

8 

86 

1  9 

1 

4888 

0.75 

0.031 

0.36 

06.2 

4 

74 

1  9 

2 

5394 

0.52 

0.033 

0.55 

16.0 

8 

85 

1  9 

3 

4463 

0.45 

0.062 

0.58 

03.9 

1 

55 

1  9 

4 

4861 

0.  12 

0.035 

0.53 

06.7 

2 

77 

1  9 

5 

4784 

0.21 

0.028 

0.62 

04.4 

6 

62 

1  9 

6 

5386 

0.22 

0.034 

0.60 

06.2 

6 

70 

1  9 

7 

4750 

0.  II 

0.031 

0.59 

04.8 

4 

67 

1  9 

8 

5331 

0.26 

0.035 

0.59 

08.4 

3 

66 

1  9 

9 

4492 

0.21 

0.045 

0.67 

07.2 

3 

58 

1  9 

10 

4914 

0.24 

0.038 

0.58 

05.7 

1 

31 

1  10 

1 

4492 

0.46 

0.044 

0.67 

II. 0 

4 

68 

1  10 

2 

5331 

0.52 

0.064 

0.80 

09.5 

4 

43 

1  10 

3 

4861 

0.42 

0.049 

0.61 

12.0 

6 

50 

1  10 

4 

5386 

0.47 

0.099 

0.66 

07.8 

4 

46 

1  10 

5 

4750 

0.32 

0.042 

0.52 

07.3 

5 

23 

1  10 

6 

4888 

0.32 

0.053 

0.59 

07.5 

1 

17 

1  10 

7 

4784 

0.05 

0.023 

0.59 

07.8 

5 

20 

1  10 

8 

4463 

0.  17 

0.036 

0.80 

03.0 

3 

29 

1  10 

9 

4914 

0.  16 

0.033 

0.64 

08.8 

3 

20 

1  10 

10 

5394 

0.  16 

0.019 

0.52 

07.3 

4 

30 

S 

1 

5331 

0.23 

0.039 

0.80 

17.0 

3 

50 

S 

2 

4784 

0.08 

0.031 

0.57 

1 1.0 

3 

23 

S 

3 

4914 

0.43 

0.031 

0.53 

04.5 

1 

30 

S 

4 

4861 

0.20 

0.030 

0.80 

1 1.0 

4 

53 

S 

5 

5  394 

0.28 

0.051 

0.51 

06.4 

3 

44 

S 

6 

4492 

0.29 

0.022 

0.50 

13.0 

3 

20 

S 

7 

4463 

0.77 

0.037 

0.61 

07.8 

6 

46 

S 

8 

5386 

0.65 

0.029 

0.50 

06.7 

3 

22 

S 

9 

4888 

0.55 

0.090 

0.54 

03.5 

2 

42 

S 

10 

4750 

0.36 

0.042 

0.61 

09.2 

3 

17 

S 

2 

1 

4784 

0.35 

0.026 

0.52 

II.O 

4 

24 

S 

2 

2 

5394 

0. 18 

0.036 

0.56 

II. 0 

4 

27 

S 

2 

3 

4463 

0.33 

0.034 

0.62 

11.0 

2 

19 

S 

2 

4 

4914 

0.65 

0.044 

0.45 

06.2 

6 

43 

S 

2 

5 

4888 
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TABLE  9  (Continued) 


PASSBAND 

NUH8ER 

MEAN 

CONTRAST 

GRAIN 

RESOLUTION 

RESOLUTION 

RIGHT 

CONFIDENCE 

TASK 

(null"* ) 

( in  51) 

0.  14 

0.067 

0.52 

13.0 

1 

19 

S 

0.35 

0.062 

0.80 

13.0 

3 

44 

S 

0.72 

0.053 

0.55 

05.4 

18 

S 

0.44 

0.069 

0.60 

09.7 

^  5 

54 

S 

0.  19 

0.034 

0.80 

07.8 

4 

09 

S 

0.06 

0.016 

0.76 

14.0 

1 

1 1 

S 

0.41 

0.034 

0.74 

10.0 

6 

33 

S 

0.35 

0.050 

0.57 

19.0 

4 

02 

S 

0.73 

0.053 

0.50 

13.0 

3 

20 

S 

0.21 

0.057 

0.80 

1  1.0 

3 

00 

S 

0.23 

0.038 

0.50 

06.6 

2 

00 

S 

0.31 

0.039 

0.61 

13.0 

3 

08 

S 

0.41 

0.027 

0.54 

03.5 

4 

30 

S 

0.  18 

0.054 

0.57 

03. 1 

1 

08 

S 

0.27 

0.039 

0.47 

15.0 

3 

14 

S 

0.38 

0.051 

0.59 

1 1.0 

4 

76 

S 

0.65 

0.055 

0.68 

15.0 

7 

82 

S 

0.  12 

0.029 

0.64 

07.8 

1 

25 

S 

0.58 

0.044 

0.64 

1 1.0 

5 

91 

S 

0.44 

0.059 

0.59 

06.7 

4 

28 

S 

0. 17 

0.053 

0.57 

05.4 

1 

60 

S 

0.25 

0.048 

0.47 

25.0 

2 

24 

S 

0.25 

0.047 

0.66 

13.0 

4 

66 

S 

0.35 

0.052 

0.55 

05.0 

4 

56 

S 

0.21 

0.035 

0.59 

02.2 

6 

60 

S 

0.67 

0.052 

0.50 

07.5 

5 

70 

S 

0.49 

0.045 

0.60 

14.0 

7 

82 

s 

0.55 

0.034 

0.63 

14.0 

5 

43 

s 

0.  18 

0.036 

0.50 

12.0 

2 

30 

s 

0.20 

0.036 

0.62 

04.6 

1 

18 

s 

0.31 

0.056 

0.62 

05.2 

2 

29 

s 

0.55 

0.079 

0.64 

05.5 

4 

40 

s 

0.31 

0.029 

0.62 

05. 1 

4 

34 

s 

0.  10 

0.065 

0.68 

05.6 

2 

32 

s 

0.57 

0.062 

0.51 

03.9 

2 

32 

s 

0.20 

0.039 

0.69 

12.0 

2 

18 

s 

0.34 

0.051 

0.56 

06.0 

4 

38 

s 

0.  19 

0.038 

0.61 

16.0 

4 

56 

s 

0.34 

0.050 

0.78 

05.7 

2 

08 

s 

ORDER  SCENE 
NO.  NO. 


82 


VE-1667-G-1 


1  PASSBAND 

CONTRAST 

GRAIN 

(resolution 

0.54 

0.054 

0.62 

0.29 

0.042 

0.44 

0.41 

0.041 

0.55 

0.62 

0.050 

0.60 

0.  12 

0.039 

0.53 

0. 17 

0.037 

0.54 

0.  II 

0.040 

0.51 

0. 17 

0.051 

0.58 

0.40 

0.085 

0.53 

0.  50 

0.042 

0.55 

0.38 

0.042 

0.63 

0.61 

0.055 

0.53 

0.38 

0.064 

0.52 

0.41 

0.067 

0.60 

0.48 

0.023 

0.56 

0.29 

0.038 

0.60 

0.44 

0.051 

0.62 

0.21 

0.037 

0.66 

0.25 

0.032 

0.60 

0.41 

0.035 

0.62 

0.64 

0.055 

0.45 

0.38 

0.035 

0.53 

0.39 

0.040 

0.48 

0.55 

0.046 

0.56 

0.26 

0.035 

0.64 

0.12 

0.026 

0.60 

0.44 

0.072 

0.59 

0.75 

0.031 

0.36 

0.52 

0.033 

0.55 

0.45 

0.062 

0.58 

0.  12 

0.035 

0.53 

0.21 

0.028 

0.62 

0.22 

0.034 

0.60 

0. 1  1 

0.031 

0.59 

0.26 

0.035 

0.59 

0.21 

0.045 

0.67 

0.24 

0.038 

0.58 

0.46 

0.044 

0.67 

TABLE  9  (Continued) 


NUM8ER  MEAN 

RESOLUTION  RIGHT  CONFIDENCE 
(mm"l )  ( in  Ji) 

18.0  3  34 

08.6  I  10 

17.0  7  32 

06.7  6  47 

12.0  2  16 

17.0  3  38 


09.2  I  30 

II. 0  4  14 

12.0  3  50 

22.0  3  33 

06.7  3  44 

07.2  6  44 

07.8  3  32 

04.8  3  13 

07.3  2  60 

04.2  I  12 


10.4  7  82 

08.9  4  66 

II. 0  3  71 

07.3  5  88 

07.0  3  56 

14.0  5  79 

40.0  0  36 

04.7  4  67 

10.0  6  81 

05.2  3  44 


10.0  3  30 

06.2  3  13 

16.0  4  68 

03.9  2  39 

06.7  0  52 

04. 4  4  29 

06.2  I  38 

04.8  0  19 

08.4  5  38 

07.2  4  30 


05.7  2  46 

1 1.0  5  45 


ORDER  SCENE 

TASK  P.l.  NO.  NO. 


S  6  5  486 1 

S  6  6  4492 

S  6  7  5386 

S  6  8  4750 

S  6  9  5394 

S  6  10  4914 


S  7  I  4784 

S  7  2  4888 

S  7  3  5331 

S  7  4  5394 

S  7  5  4750 

S  7  6  5386 

S  7  7  4463 

S  7  8  4914 

S  7  9  4492 

S  7  10  4861 


S  8  I  4888 

S  8  2  5386 

S  8  3  5331 

S  8  4  4784 

S  8  5  4914 

S  8  6  4463 

S  8  7  4861 

S  8  8  5394 

S  8  9  4750 

S  8  10  4492 


S  9  I  4888 

S  9  2  5394 

S  9  3  4463 

S  9  4  4861 

S  9  5  4784 

S  9  6  5386 

S  9  7  4750 

S  9  8  5331 

S  9  9  4492 

S  9  10  4912 


S  10  I  4492 

S  10  2  5331 
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TABLE  9 


f  PASSBAND  ] 

CONTRAST 

GRAIN 

^resolution] 

RESOLUTION 
{mni“l ) 

0.52 

0.064 

0.80 

09.5 

0.42 

0.049 

0.61 

12.0 

0.47 

0.099 

0.66 

07.8 

0.32 

0.042 

0.52 

07.3 

0.32 

0.053 

0.59 

07.5 

0.05 

0.023 

0.59 

07.8 

0.  17 

0.036 

0.80 

03.0 

0.  16 

0.033 

0.64 

08.8 

(Continued) 

NUMBER 

MEAN 

ORDER 

SCENE 

RIGHT 

CONFIDENCE 

TASK 

P.  1 . 

NO. 

NO. 

(in 

2 

31 

S 

10 

3 

4861 

7 

62 

S 

10 

4 

5386 

3 

33 

S 

10 

5 

4750 

3 

17 

S 

10 

6 

4888 

2 

40 

S 

10 

7 

4784 

3 

21 

S 

10 

8 

4463 

4 

21 

S 

10 

9 

4914 

3 

28 

S 

10 

10 

5394 
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Appendix  V  DETERMINATION  TEST 

This  appendix  is  composed  of  two  tables  and  two  figures.  Table  10 
lists:  (a)  the  measured  values  for  each  of  the  four  variables  (defined  in 
Section  II)j  used  to  describe  the  photograph,  (b)  the  number  of  targets 
correctly  identified  by  the  photo  interpreter  and  his  mean  confidence  in 
the  Identification,  and  (c)  the  photo  interpreter,  the  scene  and  set  up 
number  involved. 

The  scene  and  set  up  number  (i.  e.  ,  the  film- spatial  filter- 
contrast  combination)  were  photographically  printed  on  each  of  the  1000 
photographs.  In  the  interpretative  test  these  two  numbers  were  hidden 
by  the  cardboard  frame  and  identifications  were  maintained  by  adding  a 
PI  and  order  number.  Table  11  is  a  conversion  table  to  find  the  set  up 
and  scene  numbers  that  correspond  to  a  PI  and  order  number. 

Histograms  of  the  distribution  of  interpreter  scores  are  shown 
in  Figure  19  for  each  original  scene  and  Figure  20  for  each  inter¬ 
preter. 
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TABLE  10 


DETERMINATION  TEST  DATA 


PASSBAND  \ 


CONTRAST 

GRAIN 

^RESOLUTION 

0.86 

0.062 

0.51 

0.58 

0.062 

0.34 

0.71 

0.  150 

0.37 

0.39 

0.150 

0.48 

0.69 

0.098 

0.42 

0.52 

0.038 

0.34 

0.46 

0.062 

0.55 

0.53 

0.  150 

0.46 

0.69 

0.150 

0.42 

0.37 

0.038 

0.42 

0.69 

0.062 

0.42 

0.23 

0.098 

0.42 

0.38 

0.038 

0.42 

1.23 

0.098 

0.50 

0.37 

0.062 

0.46 

0.49 

0.  150 

0.55 

0.50 

0.062 

0.37 

0.44 

0.062 

0.37 

0.70 

0.098 

0.42 

0.51 

0.  150 

0.52 

0.75 

0.062 

0.48 

0.44 

0.062 

0.48 

0.35 

0.  150 

0.48 

0.40 

0.  150 

0.52 

0.  12 

0.038 

0.37 

0.  19 

0. 150 

0.48 

0.81 

0.062 

0.39 

0.26 

0.062 

0.45 

0.57 

0.098 

0.39 

0.52 

0.098 

0.52 

0.41 

0.038 

0.38 

0.36 

0.038 

0.45 

0.39 

0.038 

0.41 

0.83 

0.098 

0.47 

0.63 

0.062 

0.39 

0.36 

0.098 

0.46 

0.86 

0.038 

0.48 

0.  61 

0.062 

0.47 

0.42 

0.062 

0.48 

NUMBER 

MEAN 

RESOLUTION 

RIGHT 

CONFIDENCE 

( mn\“  * ) 

(in  %) 

18.0 

1 

49 

07.5 

2 

54 

14.0 

0 

72 

17.0 

0 

42 

08.5 

0 

12 

07.5 

2 

40 

09.5 

1 

31 

12.0 

2 

30 

08.5 

1 

31 

OB.  5 

0 

52 

15.0 

3 

49 

08.5 

2 

IB 

08.5 

1 

35 

15.0 

4 

7B 

12.0 

1 

33 

09.5 

0 

30 

14.0 

0 

26 

14.0 

1 

40 

15.0 

1 

19 

05.0 

17.0 

17.0 

17.0 

05.0 

14.0 

12.0 

2 

64 

08.8 

1 

69 

07.0 

2 

79 

08.8 

0 

63 

08.7 

0 

39 

09.8 

6 

95 

07.0 

2 

58 

10.0 

2 

66 

1 1.0 

2 

39 

08.8 

2 

68 

09.5 

3 

68 

12.0 

1 

43 

1 1.0 

5 

63 

12.0 

5 

80 

SET  UP 


P.l.  SCENE  NUMBER 

1 

1  21 

2 

1  229 

3 

1  203 

4 

1  47 

5 

1  149 

6 

1  221 

7 

1  60 

B 

1  133 

9 

1  151 

10 

1  136 

1 1 

1  179 

12 

1  150 

13 

1  137 

14 

1  III 

15 

1  125 

16 

1  69 

17 

1  194 

18 

1  193 

19 

1  183 

20 

1  82 

21 

1  93 

22 

1  38 

23 

1  49 

24 

1  84 

25 

1  190 

1 

2 

30 

2 

2 

215 

3 

2 

145 

4 

2 

217 

5 

2 

64 

6 

2 

187 

7 

2 

137 

8 

2 

173 

9 

2 

112 

10 

2 

212 

II 

2 

129 

12 

2 

16 

13 

2 

107 

14 

2 

25 
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TABLE  10  (Continued) 


PASSBAND  \ 


CONTRAST 

GRAIN 

^RESOLUTION 

0.16 

0.038 

0.45 

0.5^ 

0.  150 

0.52 

0.57 

0.062 

0.48 

0.63 

0.098 

0.34 

0.12 

0.038 

0.39 

0.58 

0.098 

0.53 

0.39 

0.062 

0.45 

0.51 

0.  150 

0.45 

0.  1  1 

0.038 

0.48 

0.24 

0.062 

0.42 

0.79 

0.098 

0.38 

0.38 

0.062 

0.46 

0. 10 

0.  150 

0.48 

0.41 

0.062 

0.34 

0. 19 

0.038 

0.34 

0.40 

0.062 

0.48 

0.24 

0.038 

0.48 

0.26 

0.  150 

0.53 

1.34 

0.098 

0.52 

0.71 

0.098 

0.52 

0.69 

0.098 

0.34 

0.27 

0.  150 

C.45 

0.20 

0.  150 

0.52 

0.23 

0.062 

0.48 

0.59 

0.098 

0.48 

0.24 

0.  150 

0.46 

1.05 

0.098 

0.47 

0.62 

0.098 

0.  48 

0.37 

0.098 

0.41 

0.26 

0.062 

0.39 

0.81 

0.098 

0.48 

0.16 

0.098 

0.46 

0.48 

0.  150 

0.52 

0.64 

0.062 

0.47 

1.06 

0.098 

0.39 

0.25 

0.062 

0.52 

0.23 

0.038 

0.42 

1.39 

0.098 

0.48 

0.80 

0.098 

0.52 

1.21 

0.098 

0.49 

2.  15 

0.062 

0.37 

1.08 

0.098 

0.46 

0.83 

0.098 

0.37 

0.50 

0.062 

0.55 

NUMBER 

MEAN 

RESOLUTION 

RIGHT 

CONFIDENCE 

(mm” * ) 

(in 

07.0 

1 

36 

08.7 

2 

44 

12.0 

4 

73 

06.3 

0 

47 

08.8 

1 

06 

04.7 

07.0 

07.0 

12.0 

04.6 

09.8 

12.0 

2 

63 

12.0 

0 

42 

06.3 

2 

94 

06.3 

0 

57 

12.0 

0 

56 

12.0 

4 

75 

04.7 

1 

81 

08.7 

2 

59 

08.7 

2 

52 

06.3 

0 

71 

07.0 

2 

52 

08.7 

1 

21 

12.0 

4 

5.1 

12.0 

2 

90 

09.5 

1 

55 

1  1.0 

4 

72 

12.0 

3 

76 

10.0 

1 

67 

08.8 

3 

42 

12.0 

09.5 

08.7 

1 1.0 

08.8 

08.7 

14.9 

3 

71 

16.6 

3 

78 

05.0 

3 

72 

16.8 

3 

75 

14.0 

2 

28 

12.3 

4 

69 

14.0 

3 

67 

09.5 

4 

59 

87 


SET  UP 


.  1 . 

SCENE 

NUMBER 

15 

2 

139 

16 

2 

67 

17 

2 

37 

18 

2 

234 

19 

2 

208 

20 

2 

78 

21 

2 

144 

22 

2 

151 

23 

2 

33 

24 

2 

160 

25 

2 

197 

1 

3 

94 

2 

3 

50 

3 

3 

229 

4 

3 

225 

5 

3 

10 

6 

3 

2 

7 

3 

83 

8 

3 

61 

9 

3 

62 

10 

3 

233 

1  1 

3 

154 

12 

3 

68 

13 

3 

9 

14 

3 

12 

15 

3 

134 

16 

3 

1  1 1 

17 

3 

13 

18 

3 

185 

19 

3 

214 

20 

3 

41 

21 

3 

127 

22 

3 

67 

23 

3 

106 

24 

3 

216 

25 

3 

60 

1 

4 

173 

2 

4 

42 

3 

4 

80 

4 

4 

98 

5 

4 

191 

6 

4 

128 

7  4  198 

8  t  59 
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TABLE  10  (Continued) 


/  PASSBAND  \ 

NUMBER 

MEAN 

SET  UP 

CONTRAST 

GRAIN 

\ resolution  / 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

(mm" * ) 

(in  t) 

0.85 

0.098 

0.42 

14.9 

5 

56 

9 

4 

184 

0.60 

0.098 

0.55 

09.5 

1 

36 

10 

4 

64 

0.88 

0.038 

0.52 

18.0 

5 

78 

1 1 

4 

2 

0.32 

0.038 

0.55 

09.5 

4 

49 

12 

4 

54 

0.48 

0.098 

0.55 

09.5 

2 

42 

13 

4 

65 

0.84 

0.098 

0.39 

10.4 

3 

88 

14 

4 

220 

0.90 

0.062 

0.49 

16.8 

2 

81 

15 

4 

95 

2.00 

0.098 

0.55 

09.5 

4 

84 

16 

4 

61 

1. 32 

0.062 

0.42 

14.9 

7 

90 

17 

4 

178 

0.80 

0.038 

0.50 

15.0 

3 

81 

18 

4 

101 

1.55 

0.062 

0.42 

14.9 

8 

63 

19 

4 

176 

0.24 

0.038 

0.34 

07.5 

20 

4 

225 

1.93 

0.098 

0.48 

16.6 

21 

4 

41 

1.  18 

0.062 

0.46 

12.3 

22 

4 

122 

0.  36 

0.038 

0.42 

08.5 

23 

4 

140 

1.09 

0.062 

0.42 

08.5 

24 

4 

142 

2.  17 

0.098 

0.39 

10.4 

25 

4 

216 

0.46 

0.  150 

0.38 

09.8 

4 

66 

1 

5 

202 

I.OI 

0.098 

0.29 

04.4 

0 

59 

2 

5 

242 

0.96 

0.098 

0.46 

12.0 

5 

81 

3 

5 

99 

0.61 

0.062 

0.52 

08.7 

1 

66 

4 

5 

56 

0.39 

0.062 

0.53 

04.7 

2 

45 

5 

5 

73 

0.61 

0.038 

0.52 

08.7 

4 

99 

6 

5 

52 

1.13 

0.  150 

0.42 

04.6 

3 

57 

7 

5 

166 

0.42 

0.038 

0.48 

11.6 

5 

75 

8 

5 

34 

0.71 

0.038 

0.45 

07.0 

2 

42 

9 

5 

1 36 

0. 15 

0.098 

0.39 

08.8 

1 

47 

10 

5 

216 

0.93 

0.098 

0.34 

06.3 

3 

70 

1 1 

5 

231 

0.79 

0.098 

0.38 

09.8 

2 

75 

12 

5 

198 

0.87 

0.062 

0.46 

09.5 

0 

73 

13 

5 

123 

0.75 

0.062 

0.34 

06.3 

4 

87 

14 

5 

227 

0.40 

0.  150 

0.53 

04.7 

3 

88 

15 

5 

84 

0.61 

0.098 

0.48 

12.4 

1 

77 

16 

5 

13 

0.70 

0.062 

0.46 

12.0 

5 

52 

17 

5 

93 

1.  19 

0.098 

0.46 

12.0 

1 

48 

18 

5 

97 

0.79 

0.52 

0.64 

0.79 

0.062 

0.062 

0.062 

0.062 

0.53 

0.53 

0.34 

0.45 

06.3 

04.7 

06.3 

07.0 

3 

59 

19 

20 
21 
22 

5 

5 

5 

5 

c 

229 

74 

228 

141 

1 

0.44 

0.80 

0.86 

0.038 

0.062 

0.098 

0.48 

0.46 

0.47 

12.4 

12.0 

11.2 

23 

24 

25 

9 

5 

5 

1 

91 

112 

88 

VE-1667 
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TABLE  10  (Continued) 


/  PASSBAND  \ 

NUMBER 

MEAN 

SET  UP 

CONTRAST 

GRAIN 

Resolution/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

(mm" *) 

( in 

0.  17 

0.038 

0.55 

09.5 

0 

56 

1 

6 

53 

0.63 

0.098 

0.52 

05.0 

1 

42 

2 

6 

76 

0.24 

0.  150 

0.55 

09.5 

0 

57 

3 

6 

70 

0.34 

0.038 

0.37 

14.0 

0 

44 

4 

6 

186 

0.48 

0.098 

0.49 

17.0 

0 

1 1 

5 

6 

100 

0.55 

0.062 

0.37 

14.0 

4 

65 

6 

6 

192 

0.35 

0.062 

0.52 

05.0 

0 

39 

7 

6 

72 

0.59 

0.098 

0.34 

07.5 

3 

74 

8 

6 

232 

0.23 

0.038 

0.37 

14.0 

1 

39 

9 

6 

189 

0.43 

0.038 

0.50 

15.0 

1 

77 

10 

6 

102 

0.25 

0.038 

0.34 

07.5 

3 

51 

1  1 

6 

222 

0.38 

0.038 

0.46 

12.0 

1 

34 

12 

6 

116 

0.56 

0.098 

0.52 

05.0 

1 

21 

13 

6 

77 

0.36 

0.  150 

0.52 

05.0 

1 

72 

14 

6 

83 

0.55 

0.098 

0.42 

15.0 

0 

26 

15 

6 

184 

0.26 

0.038 

0.42 

15.0 

2 

59 

16 

6 

173 

0.  18 

0.038 

CO 

o 

07.5 

1 

28 

17 

6 

223 

0.33 

0.038 

0.37 

14.0 

3 

30 

18 

6 

188 

0.25 

0.  150 

0.48 

16.6 

0 

36 

19 

6 

48 

0.  12 

0.038 

0.52 

18.0 

20 

6 

5 

0.43 

0.038 

0.50 

15.0 

21 

6 

109 

0.38 

0.062 

0.42 

15.0 

22 

6 

180 

0.34 

0.062 

0.43 

04.8 

23 

6 

160 

0.40 

0.062 

0.42 

15.0 

24 

6 

178 

0.22 

0.038 

0.46 

12.0 

25 

6 

1  18 

0. 17 

0.038 

0.42 

08.5 

1 

44 

1 

7 

139 

0.45 

0.038 

0.49 

16.8 

1 

57 

2 

7 

94 

0.62 

0.062 

0.37 

14.0 

3 

66 

3 

7 

192 

0.53 

0.062 

0.34 

07.5 

0 

1 1 

4 

7 

228 

0.  18 

0.038 

0.49 

16.8 

0 

06 

5 

7 

89 

0.62 

0.038 

0.39 

10.4 

2 

61 

6 

7 

206 

0.26 

0.038 

0.55 

09.5 

2 

51 

7 

7 

53 

0. 1  1 

0.  150 

0.52 

05.0 

1 

27 

8 

7 

85 

0.13 

0.038 

0.48 

16.6 

0 

07 

9 

7 

35 

0.57 

0.098 

0.48 

16.6 

1 

70 

10 

7 

44 

0.43 

0.098 

0.52 

18.0 

4 

60 

1 1 

7 

15 

0.  18 

0.038 

0.52 

18.0 

0 

32 

12 

7 

5 

1.  10 

0.098 

0.42 

08.5 

3 

48 

13 

7 

146 

0.30 

0.062 

0.37 

14.0 

1 

49 

14 

7 

195 

0.33 

0.  150 

0.55 

09.5 

0 

50 

15 

7 

69 

0.65 

0.098 

0.  33 

04.3 

1 

28 

16 

7 

242 

0.56 

0.098 

0.52 

05.0 

1 

03 

17 

7 

79 

0.65 

0.062 

0.39 

10.4 

0 

47 

18 

7 

212 

0.72 

0.062 

0.50 

15.0 

4 

58 

19 

7 

107 

89 
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TABLE  10  (Continued) 


/  PASSBAND  \ 

CONTRAST  GRAIN 

Resolution/ 

RESOLUTION 

(mm"  ) 


0.39 

0.098 

0.34 

07.5 

0.20 

0.038 

0.55 

09.5 

0.60 

0.098 

0.42 

08.5 

0.24 

0.038 

0.49 

16.8 

0.52 

0.150 

0.33 

04.3 

0.52 

0.038 

0.50 

15.0 

NUMBER 

MEAN 

SET  UP 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

( in5i) 

20 

7 

235 

21 

7 

54 

22 

7 

149 

23 

7 

88 

24 

7 

248 

25 

7 

101 

0.87 

0.038 

0.42 

0.55 

0.062 

0.50 

0.55 

0.038 

0.50 

0.67 

0. 150 

0.33 

0.68 

0.150 

0.52 

0.51 

0.098 

0.52 

0.45 

0.150 

0.43 

0.80 

0.062 

0.5  2 

0.48 

0.4  50 

0.42 

1.09 

0.150 

0.37 

0.32 

0.098 

0.50 

0.90 

0.098 

0.52 

0.70 

0.062 

0.39 

0.52 

0.062 

0.48 

0.64 

0.038 

0.51 

0.55 

0.062 

0.48 

0.56 

0.  150 

0.46 

0.84 

0.062 

0.42 

0.35 

0.038 

0.51 

0.49 

0.062 

0.37 

0.30 

0.038 

0.50 

0.38 

0.062 

0.55 

0.50 

0.062 

0.49 

0.52 

0.098 

0.52 

0.40 

0.038 

0.39 

14.9 

2 

63 

15.0 

3 

74 

15.0 

3 

79 

04.3 

0 

5  1 

05.0 

0 

32 

18.0 

2 

76 

04.8 

0 

38 

18.0 

3 

58 

08.5 

1 

50 

14.0 

0 

76 

15.0 

2 

41 

18.0 

8 

26 

10.4 

0 

24 

16.6 

5 

74 

17.6 

2 

53 

16.6 

2 

60 

12.6 

2 

48 

08.5 

1 

70 

17.6 

2 

53 

m.o 

15.0 

09.5 

16.8 

05.0 

10. 


1  8  171 

2  8  109 

3  8  101 

4  8  247 

5  8  81 

6  8  15 

7  8  168 

8  8  7 

9  8  152 

10  8  201 

11  8  115 

12  8  12 

13  8  213 

14  8  40 

15  8  16 

16  8  39 

17  8  132 

18  8  143 

19  8  18 

20  8  196 

21  8  102 

22  8  59 

23  8  95 

24  8  80 

25  8  207 


0.47 

0.062 

0.53 

0.23 

0.038 

0.46 

0.53 

0.  150 

0.52 

0.44 

0.  150 

0.34 

0.57 

0.150 

0.46 

0.27 

0.150 

0.48 

0.32 

0.038 

0.45 

0.43 

0.098 

0.42 

0.82 

0.098 

0.45 

0.34 

0.062 

0.42 

0.37 

0.038 

0.47 

04.7 

2 

49 

12.0 

3 

84 

08.7 

3 

85 

06.3 

3 

37 

09.5 

0 

30 

11.6 

2 

77 

07.0 

2 

73 

04.6 

0 

32 

07.0 

1 

56 

04.6 

3 

56 

11.2 

3 

73 

1  9  71 

2  9  87 

3  9  66 

4  9  237 

5  9  132 

6  9  50 

7  9  138 

8  9  164 

g  9  146 

10  9  158 

11  9  102 
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TABLE  10  (Continued) 


/  PASSBAND  \ 

CONTRAST 

GRAIN 

\ RESOLUTION/ 

RESOLUTION 

( mm*  * ) 

0.2>l 

0.062 

0.53 

04.7 

0.74 

0.098 

0.46 

09.5 

0.78 

0.098 

0.48 

12.4 

0.61 

0.062 

0.42 

04.6 

0.57 

0.062 

0.52 

08.7 

0.35 

0.  150 

0.42 

04.6 

0.38 

0.  150 

0.38 

09.8 

0.31 

0.062 

0.48 

12.4 

0.30 

0.038 

0.48 

12.0 

0.67 

0.062 

0.45 

07.0 

0.65 

0.062 

0.46 

09.5 

0.22 

0.038 

0.34 

06.3 

0.71 

0.  150 

0.48 

11.6 

0.72 

0.062 

0.48 

11.6 

0.54 

0.098 

0.46 

12.0 

0.61 

0.038 

0.52 

08.7 

0.77 

0.  150 

0.38 

09.8 

0.51 

0.098 

0.53 

0*1.7 

0.28 

0.038 

0.  46 

12.0 

0.43 

0.038 

0.47 

11.2 

0.47 

0.038 

0.52 

08.7 

1.23 

0.038 

0.41 

10.0 

0.52 

0.062 

0.48 

12.0 

0.26 

0.098 

0.42 

04.6 

0.62 

0.098 

0.34 

06.3 

0.53 

0.062 

0.48 

12.4 

0.28 

0.038 

0.39 

08.8 

0.90 

0. 150 

0.38 

09.8 

0.  14 

0.  150 

0.54 

04.7 

0.34 

0.062 

0.42 

04.6 

0.32 

0.098 

0.39 

08.8 

0.69 

0.  150 

0.29 

04.4 

0.23 

0.038 

0.48 

11.6 

0.27 

0.038 

0.48 

11.6 

0.79 

0.062 

0.53 

04.7 

1.27 

0.098 

0.34 

06.3 

0.39 

0.062 

0.34 

06.3 

0.24 

0.038 

0.48 

05.9 

0.77 

0.098 

0.34 

06.3 

0.29 

0.062 

0.49 

16.8 

0.09 

0.038 

0.50 

15.0 

0.21 

0.098 

0.39 

10.4 

NUMBER 

MEAN 

SET  UP 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

(in  %) 

1. 

27 

12 

9 

74 

2 

43 

13 

9 

127 

3 

79 

14 

9 

14 

2 

76 

15 

9 

157 

3 

49 

16 

9 

57 

2 

24 

17 

9 

168 

2 

55 

18 

9 

204 

2 

14 

19 

9 

9 

20 

9 

19 

21 

9 

141 

22 

9 

124 

23 

9 

223 

24 

9 

46 

25 

9 

37 

3 

68 

1 

10 

100 

3 

91 

2 

10 

51 

2 

97 

3 

10 

204 

0 

57 

4 

10 

79 

0 

34 

5 

10 

90 

4 

87 

6 

10 

102 

5 

87 

7 

10 

52 

2 

72 

8 

10 

171 

4 

90 

9 

10 

23 

1 

66 

IQ 

10 

164 

3 

81 

1 1 

10 

234 

4 

50 

12 

10 

10 

3 

58 

13 

10 

209 

2 

83 

14 

10 

202 

4 

77 

15 

10 

85 

2 

83 

16 

10 

159 

4 

76 

17 

10 

220 

3 

88 

18 

10 

246 

5 

63 

19 

10 

34 

20 

10 

33 

21 

10 

72 

22 

10 

231 

23 

10 

230 

24 

10 

2 

25 

10 

232 

5 

72 

1  II  92 

0 

50 

2  II  105 

0 

58 

3  II  220 

VE-1667-G-1 
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TABLE  10  (Continued) 


i  PASSBAND  \ 

NUMBER 

MEAN 

SET  UP 

CONTRAST 

GRAIN 

Iresolution/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

(mm“ * ) 

(in  %) 

0.24 

0.062 

0.37 

14.0 

2 

30 

4 

1 1 

192 

0.06 

0.  150 

0.42 

08.5 

1 

20 

5 

1 1 

155 

0.21 

0.062 

0.42 

08.5 

1 

60 

6 

II 

143 

0.  13 

0.098 

0.39 

10.4 

1 

61 

7 

1 1 

219 

0.20 

0.062 

0.  39 

10.4 

1 

54 

8 

1 1 

215 

0.  18 

0.098 

0.37 

14.0 

1 

45 

9 

1  1 

199 

0.  19 

0.098 

0.42 

08.5 

2 

52 

10 

1 1 

147 

0.24 

0.062 

0.46 

12.3 

5 

69 

II 

1 1 

121 

0.  1  1 

0.  150 

0.34 

07.5 

0 

27 

12 

1  1 

239 

0.09 

0.062 

0.34 

07.5 

2 

39 

13 

1 1 

230 

0.  15 

0.062 

0.49 

16.8 

2 

70 

14 

1 1 

94 

0.23 

0.062 

0.  34 

07.5 

4 

81 

15 

1  1 

226 

0.  19 

0.098 

0.43 

04.8 

0 

27 

16 

1 1 

163 

0.  10 

0.  150 

0.48 

16.6 

0 

00 

17 

1 1 

50 

0.41 

0.062 

0.43 

04.8 

2 

48 

18 

II 

1 56 

0.27 

0.37 

0.27 

0.098 

0. 098 
0.098 

0.46 

0.33 

0.39 

12.3 

04.3 

10.4 

1 

36 

19 

20 

21 

II 

1 1 

II 

1  1 

128 

241 

218 

Aft 

0.  10 
0.09 
0.22 
0.20 

0.038 

0.038 

0.098 

0.062 

0.49 

0.42 

0.42 

0.50 

16.8 

14.9 

08.5 

15.0 

22 

23 

24 

25 

1  1 

II 

II 

1  1 

OO 

174 

146 

109 

0.28 

0.25 

0.  150 

0.  150 

0.46 

0.34 

09.5 

06.3 

2 

1 

51 

26 

1 

2 

12 

12 

133 

240 

0.22 

0.  15 
0.48 
0.29 

0.  150 

0.  150 
0.098 
0.098 

0.48 

0.46 

0.47 

0.45 

11.6 

09.5 

11.2 

07.0 

0 

3 

3 

2 

50 

25 

57 

43 

3 

4 

5 

6 

12 

12 

12 

12 

50 

131 

1  13 
147 

0.33 

0.30 

0.37 

0.35 

0.22 

0.038 

0.062 

0.062 

0.098 

0.038 

0.46 

0.47 

0.46 

0.47 

0.52 

12.0 

11.2 

09.5 

11.2 

08.7 

2 

0 

1 

0 

2 

63 

45 

25 

1  1 

40 

7 

8 

9 

10 

II 

12 

12 

12 

12 

12 

87 

1 10 
124 

1 15 
63 

0.23 

0.  10 
0.28 

0.  18 
0.21 

0.  12 
0.47 

0.  12 
0.25 

0.038 

0.038 

0.  150 
0.098 
0.038 
0.062 
0.062 
0.  150 
0.038 

0.48 

0.47 

0.52 

0.42 

0.48 

0.52 

0.46 

0.48 

0.52 

12.4 

11.2 

08.7 

04.6 

12.4 

08.7 

09.5 

12.0 

08.7 

2 

0 

1 

1 

1 

6 

1 

1 

2  1 

22 

49 

15 

22 

46 

38 

03 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 

12 

12 

12 

12 

12 

12 

12 

12 

12 

12 

4 

104 

68 

165 

3 

59 

122 

29 

52 

120 

0.04 

0.038 

0.46 

09.5 

22 

12 

1 17 

0.44 

0.038 

0.46 

09. 5 

23 

12 

188 

0.  15 

0.038 

0.38 

09.8 

24 

12 

1 19 

0.07 

0.038 

0.46 

09. 5 

25 

12 

127 

0.51 

0.098 

0.46 

09. 5 

92 
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TABLE  10  (Continut3 

Id) 

/  PASSBAND  \ 

NUMBER 

MEAN 

SET  UP 

CONTRAST 

GRAIN 

UtSOLUTIONy 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

■ 

(mm" * ) 

(in  ii) 

0,27 

0.  150 

0.  42 

08.5 

0 

49 

1 

13 

240 

0.22 

0.062 

0.48 

16.6 

3 

38 

2 

13 

40 

0.24 

0.098 

0.39 

10.4 

2 

74 

3 

13 

218 

0.33 

0.038 

0.42 

08.5 

1 

56 

4 

13 

138 

0.24 

0.098 

0.48 

16.6 

3 

35 

5 

13 

44 

0.28 

0.098 

0.55 

09.5 

4 

72 

6 

13 

63 

0.24 

0.062 

0.42 

08.5 

4 

60 

7 

13 

144 

0.27 

0.  150 

0.42 

08.5 

1 

45 

8 

13 

155 

0.52 

0.062 

0.37 

14.0 

3 

69 

9 

13 

191 

0.  15 

0.038 

0.50 

15.0 

1 

17 

10 

13 

105 

0.34 

0.098 

0.37 

14.0 

1 

64 

II 

13 

198 

0.29 

0.038 

0.46 

12.3 

1 

23 

12 

13 

120 

0.34 

0.038 

0.42 

08.  5 

4 

56 

13 

13 

147 

0.54 

0.098 

0.42 

14.9 

3 

77 

14 

13 

182 

0.44 

0.098 

0.49 

16.8 

5 

57 

15 

13 

97 

0.08 

0.038 

0.50 

15.0 

1 

46 

16 

13 

104 

0.  12 

0.038 

0.  50 

15.0 

3 

61 

17 

13 

103 

0.73 

0.098 

0.46 

12.3 

6 

78 

18 

13 

126 

0.33 

0.038 

0.39 

10.4 

3 

64 

19 

13 

206 

0.21 

0.038 

0.48 

16.6 

20 

13 

32 

0.22 

0.098 

0.46 

12.3 

21 

13 

130 

0.  1 1 

0.038 

0.51 

17.6 

22 

13 

18 

0.  15 

0.038 

0.48 

16.6 

23 

13 

34 

0.52 

0.098 

0.50 

15.0 

24 

13 

112 

0.  15 

0.062 

0.43 

04.8 

25 

13 

159 

0.  39 

0.062 

0.38 

09.8 

2 

55 

1 

14 

194 

0.  17 

0.062 

0.48 

11.6 

2 

42 

2 

14 

39 

0.33 

0.038 

0.46 

09.5 

4 

55 

3 

14 

1 18 

0.70 

0.098 

0.45 

07.0 

1 

60 

4 

14 

148 

0.43 

0.062 

0.45 

07.0 

1 

29 

5 

14 

145 

0.45 

0. 150 

0.34 

06.3 

2 

82 

6 

14 

240 

0.37 

0.038 

0.48 

11.6 

6 

81 

7 

14 

32 

0.34 

0.038 

0.48 

12.4 

1 

44 

8 

14 

3 

0.53 

0.  150 

0.48 

12.0 

2 

60 

9 

14 

26 

0.54 

0.098 

0.45 

07.0 

1 

54 

10 

14 

150 

0.41 

0.  150 

0,42 

04.6 

2 

42 

1 1 

14 

169 

0.33 

0.  150 

0.29 

04.4 

1 

24 

12 

14 

250 

0.42 

0.  150 

0.34 

06.3 

3 

40 

13 

14 

238 

0. 32 

0.038 

0.48 

12.0 

4 

85 

14 

14 

18 

0.  32 

0.038 

0.48 

12.0 

2 

36 

15 

14 

17 

0.65 

0.038 

0.38 

09.8 

2 

69 

16 

14 

187 

1.07 

0.098 

0.41 

IQ.O 

5 

64 

17 

14 

181 

0.74 

0.098 

0.48 

11.6 

5 

21 

18 

14 

45 

0.51 

0.098 

0.52 

08.7 

2 

49 

19 

14 

64 

93 

VE-1667 

-G-1 

TABLE  10  (Continued) 


f  PASS8AN0  \  HUMBER  MEAH  SET  UP 

CONTRAST  GRAIN  UeSOLUTIOH/  RESOLUTION  RIGHT  CONFIDENCE  P.  I.  SCENE  HUMBER 


0.94 

0.09B 

0.48 

O.BQ 

0.  150 

0.29 

0.71 

0.098 

0.41 

0.51 

0.062 

0.47 

0.38 

0.  150 

0.38 

0.53 

0.  150 

0.45 

1.69  1 

0.098 

0.39 

0.83 

0.098 

0.39 

0.  15 

0.  150 

0.33 

0.94 

0.062 

0.52 

0.77 

0.  150 

0.33 

0.44 

0.  150 

0.33 

1.03 

0.098 

0.42 

0.73 

0.038 

0.42 

2.  1  1 

0.098 

0.33 

1.56 

0.098 

0.39 

0.67 

0.098 

0.33 

1.57 

0.062 

0.42 

1.  23 

0.  150 

0.33 

1.07 

0.098 

0.  33 

0.67 

0.038 

0.49 

1.  15 

0.  150 

0.33 

1.77 

0.098 

0.34 

1.  18 

0.062 

0.34 

0.60 

0.098 

0.55 

1.26 

0.098 

0.33 

1.84 

0.098 

0.46 

0.66 

0.038 

0.34 

0.48 

0.062 

0.42 

0.23 

0.038 

0.49 

0.99 

0.  150 

0.42 

0.35 

0.  150 

0.43 

0.48 

0.038 

0.42 

0.47 

0.062 

0.52 

0.38 

0.038 

0.48 

0.76 

0.062 

0.42 

1.09 

0.Q9B 

0.52 

0.45 

0.  150 

0.37 

0.94 

0.038 

0.39 

0.57 

0.038 

0.34 

0.37 

0.098 

0.34 

0.27 

0.038 

0.52 

{ mm“ * )  (I 


04.4 
10.0 
11.2 
09. B 
07.0 


10.4  0 

10.4  I 

04.3  0 

05.0  0 

04.3  0 

04.3  0 

OB.  5  0 

OB. 5  0 

04.3  2 

10.4  0 

04.3  0 

14.9  0 

04.3  0 

04.3  5 

16.8  0 

04.3  0 

07.5  6 

07.5  0 

09.5  0 

04.3 


12.3 
07.5 
08.5 
16. B 
OB. 5 


04. B  0 

14.9  3 

05.0  I 

16.6  0 

OB. 5  I 

05.0  1 

14.0  2 

10.4  I 

07.5  0 

07.5  0 

IB.O  I 


20 

14 

11 

21 

14 

246 

22 

14 

182 

23 

14 

109 

24 

14 

204 

25 

14 

154 

25 

1 

15 

216 

33 

2 

15 

218 

32 

3 

15 

250 

30 

4 

15 

71 

44 

5 

15 

248 

16 

6 

15 

249 

1 1 

7 

15 

149 

09 

8 

15 

136 

30 

9 

15 

241 

31 

10 

15 

217 

14 

11 

15 

245 

11 

12 

15 

176 

43 

13 

15 

246 

70 

14 

15 

244 

39 

15 

15 

87 

36 

16 

15 

247 

74 

17 

15 

231 

39 

18 

15 

227 

24 

19 

15 

65 

20 

15 

243 

21 

15 

126 

22 

15 

222 

23 

15 

145 

24 

15 

.90 

25 

15 

152 

24 

1 

16 

168 

34 

2 

16 

175 

77 

3 

16 

73 

43 

4 

16 

32 

45 

5 

16 

143 

63 

6 

16 

77 

49 

7 

16 

205 

58 

8 

16 

206 

37 

9 

16 

222 

IB 

10 

16 

235 

13 

11 

16 

5 

94 
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TABLE  10  (Continued) 


/  PASSBANO  \ 

CONTRAST 

GRAIN 

^RESOLUTION/ 

RESOLUTION 

( mm" ' ) 

1.35 

0.098 

0.42 

08.5 

0.26 

0.038 

0.55 

09.5 

0.28 

0.038 

0.  50 

15.0 

0.62 

0.062 

0.37 

14.0 

0.95 

0.062 

0.46 

12.3 

0.22 

0.  150 

0.43 

04.8 

0.32 

0.038 

0.50 

15.0 

0.59 

0.  150 

0.43 

04.8 

0.86 

0.098 

0.50 

15.0 

0.65 

0.038 

0.55 

09.5 

0.56 

0.038 

0.42 

14.9 

0.24 

0.038 

0.39 

10.4 

0.73 

0.062 

0.43 

04.8 

0.81 

0.062 

0.42 

14.9 

0.45 

0.062 

0.48 

12.4 

0.67 

0.098 

0.53 

04.7 

0.  19 

0.  150 

0.46 

09.5 

0.55 

0.038 

0.45 

07.0 

0.90 

0.098 

0.46 

09.5 

1. 18 

0.  150 

0.45 

07.0 

1.43 

0.098 

0.48 

12.4 

0.98 

0.098 

0.38 

09.8 

0.70 

0.098 

0.46 

12.0 

0.80 

0.062 

0.52 

08.7 

1.09 

0.098 

0.53 

04.7 

0.33 

0.038 

0.39 

08.8 

0.75 

0.098 

0.47 

11.2 

0.51 

0.062 

0.48 

12.4 

0.28 

0.  150 

0.42 

04.6 

0.43 

0.062 

0.47 

11.2 

0.63 

0.062 

0.41 

10.0 

0.62 

0.038 

0.41 

10.0 

0.44 

0.062 

0.42 

04.6 

0.63 

0.038 

0.48 

12.4 

0.42 

0.  150 

0.38 

09.8 

0.35 

0.038 

0.38 

09.8 

0.63 

0.038 

0.34 

06.3 

0.91 

0.  150 

0.52 

08.7 

0.86 

0.098 

0.48 

11.6 

0.22 

0.098 

0.46 

12.3 

0.29 

0.038 

0.37 

14.0 

0.26 

0.038 

0.49 

16.8 

NUMBER 

MEAN 

SET  UP 

RIGHT 

CONFIDENCE 

P.  1 . 

SCENE 

NUMBER 

(in  /.) 

4 

39 

12 

16 

146 

1 

01 

13 

16 

55 

1 

66 

14 

16 

104 

0 

39 

15 

16 

194 

2 

56 

16 

16 

122 

0 

05 

17 

16 

170 

0 

42 

18 

16 

103 

0 

18 

19 

16 

167 

20 

16 

129 

21 

16 

51 

22 

16 

174 

23 

16 

210 

24 

16 

158 

25 

16 

179 

4 

70 

1 

17 

8 

2 

61 

2 

17 

80 

4 

64 

3 

17 

135 

1 

65 

4 

17 

137 

4 

41 

5 

17 

127 

4 

70 

6 

17 

151 

2 

75 

7 

17 

11 

3 

63 

8 

17 

198 

3 

46 

9 

17 

100 

2 

43 

10 

17 

58 

4 

38 

1 1 

17 

77 

1 

29 

12 

17 

208 

2 

39 

13 

17 

1  14 

7 

89 

14 

17 

9 

1 

45 

15 

17 

170 

5 

70 

16 

17 

1  10 

7 

68 

17 

17 

179 

3 

59 

18 

17 

172 

1 

16 

19 

17 

159 

20 

17 

1 

21 

17 

205 

22 

17 

190 

23 

17 

221 

24 

17 

66 

25 

17 

43 

1 

58 

1 

18 

130 

0 

57 

2 

18 

189 

4 

68 

3 

18 

88 

95 


VE-1667-G-1 


TABLE  10  (Continued) 


/  PASS8AMD  \ 

CONTRAST  GRAIN  \ RESOLUTION/  RESOLUTION 

(lUB-') 


0.  18 

0.098 

0.39 

0.098 

0.69 

0.062 

0.28 

0.098 

0.50 

0.098 

0.93 

0.  150 

0.27 

0.  150 

0.54 

0.098 

0.08 

0.038 

0.27 

0.038 

0.38 

0.098 

0.20 

0.  150 

0.32 

0.062 

0.91 

0.098 

0.38 

0.062 

0.  29 

0.038 

0.35 

0.062 

0.47 

0.  150 

0.  12 

0.038 

0.49 

0.062 

0.58 

0.062 

0.35 

0.098 

1.39 

0.098 

1.20 

0.098 

0.36 

0.  150 

0.47 

0.038 

0.  18 

0.038 

0.  33 

0.038 

0.59 

0.098 

0.97 

0.098 

0.68 

0.  150 

0.  26 

0.038 

0.33 

0.038 

0.23 

0.038 

0.50 

0.098 

0.73 

0.062 

0.51 

0.062 

0.43 

0.062 

0.29 

0.  150 

0.74 

0.038 

1.  10 

0.098 

0.68 

0.  150 

0.46 

0.062 

0.48 

0.  150 

0.94 

0.  150 

0.27 

0.038 

0.59 

0.  150 

0.48  16.6 


0.49 

16.8 

0.51 

17.6 

0.50 

15.0 

0.49 

16.8 

0.46 

12.3 

0.51 

17.6 

0.42 

08.5 

0.39 

10.4 

0.42 

14.9 

0.46 

12.3 

0.55 

09.5 

0.51 

17.6 

0.55 

09.5 

0.51 

17.6 

0.46 

12.3 

0.49 

16.8 

0.55 

09.5 

0.48 

16.6 

0.48 

16.6 

0.34 

07.5 

0.37 

14.0 

0.42 

14.9 

0.43 

04.8 

C.5I 

17.6 

0.34 

07.5 

0.34 

07.5 

0.42 

08.5 

0.55 

09.5 

0.49 

16.8 

0.43 

04.8 

0.51 

17.6 

0.39 

10.4 

0.46 

12.3 

0.33 

04.3 

0.34 

07.5 

0.42 

08.5 

0.  43 

04.8 

0.55 

09.5 

0.51 

17.6 

0.  37 

07.5 

0.34 

07.5 

0.49 

16.8 

0.48 

16.6 

0.48 

16.6 

0.37 

14.0 

0.34 

07.5 

NUH8ER 

RIGHT 


0 

3 
7 
1 

0 

2 

0 

4 
0 
3 
6 
0 
2 

3 

4 

5 


MEAN 

CONFIDENCE 

(in  %) 

62 

45 
99 
43 
43 
56 

46 
52 
II 
66 
70 
59 
67 
78 
67 
56 


4 

3 

4 
1 
1 

3 

3 

3 

2 

5 
3 
2 
2 
3 
2 
2 

3 
5 

4 


50 

72 

73 
73 
42 
40 
86 
72 
61 
81 
45 
55 
17 
90 
93 
69 
47 
89 
32 


SET  UP 


1. 

SCENE 

NUH8ER 

4 

18 

44 

5 

18 

98 

6 

18 

21 

7 

18 

115 

8 

18 

97 

9 

18 

131 

10 

18 

29 

II 

18 

147 

12 

18 

209 

13 

18 

175 

14 

18 

129 

15 

18 

68 

16 

18 

25 

17 

18 

61 

18 

18 

24 

19 

18 

117 

20 

18 

94 

21 

18 

66 

22 

18 

33 

23 

18 

38 

24 

18 

226 

25 

18 

199 

1 

19 

181 

2 

19 

161 

3 

19 

28 

4 

19 

221 

5 

19 

224 

6 

19 

137 

7 

19 

63 

8 

19 

96 

.9 

19 

166 

10 

19 

18 

11 

19 

207 

12 

19 

1 19 

13 

19 

244 

14 

19 

226 

15 

19 

142 

16 

19 

158 

17 

19 

70 

18 

19 

16 

19 

19 

232 

20 

19 

237 

21 

19 

95 

22 

19 

48 

23 

19 

46 

24 

19 

190 

25 

19 

239 

96 


VE-1667-G-1 


CONTRAST 


0.35 
0.45 
0.54 
0.96 
0.35 
0.46 
0.37 
0.39 
0.72 
0.82 
0.40 
0.64 
0.64 
0.27 
0.58 
I.  16 
0.38 
0.50 
1.21 
0.23 
0.35 
1.02 
0.65 
0. 19 
0.53 


1.25 
0.29 
0.59 
0.46 
0. 18 
0.28 
0.39 
0.35 
0.22 
0.77 
0.21 
0.76 
0.42 
0.74 
0.44 
0.65 
0.24 
0.54 
0.47 


table  10  (Continued) 


j 

f  PASS8AND  \ 

NUM8ER 

MEAN 

SET  UP 

GRAIN  ' 

^RESOLUTION/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUM8ER 

( mm“ * ) 

(in  %) 

0.038 

0.48 

16.6 

1 

65 

1 

20 

32 

0.  150 

0.37 

14.0 

0 

67 

2 

20 

205 

0.062 

0.42 

08.5 

4 

85 

3 

20 

144 

0.062 

0.39 

10.4 

1 

56 

4 

20 

21  1 

0.038 

0.55 

09.5 

2 

50 

5 

20 

52 

0.098 

0.42 

08.5 

1 

84 

6 

20 

150 

0.038 

0.34 

07.5 

1 

57 

7 

20 

222 

0.038 

0.52 

18.0 

2 

62 

8 

20 

4 

0.062 

0.52 

05.0 

0 

57 

9 

20 

71 

0.098 

0.49 

16.8 

1 

90 

10 

20 

196 

0.038 

0.52 

(8.0 

2 

62 

11 

20 

3 

0.062 

0.46 

12.3 

2 

61 

12 

20 

123 

0.062 

0.46 

12.3 

1 

49 

13 

20 

124 

0.038 

0.48 

16.6 

4 

84 

14 

20 

.35 

0.098 

0.50 

15.0 

0 

99 

15 

20 

1 14 

0.098 

0.34 

07.5 

1 

53 

16 

20 

231 

0.038 

0.37 

14.0 

4 

62 

17 

20 

189 

0.038 

0.52 

18.0 

2 

58 

18 

20 

1 

241 

0.098 

0.33 

04.3 

0 

17 

19 

20 

0.038 

0.50 

15.0 

20 

20 

104 

0.062 

0.37 

14.0 

21 

20 

195 

0.098 

0.52 

05.0 

22 

20 

78 

0.062 

0.42 

14.9 

23 

20 

179 

0.038 

0.42 

08.5 

24 

20 

138 

0.098 

0.37 

14.0 

25 

20 

200 

0.062 

0.41 

10.0 

5 

66 

1 

21 

176 

0.038 

0.38 

09.8 

1 

47 

2 

21 

187 

0.062 

0.48 

11.6 

6 

93 

3 

21 

36 

0.062 

0.53 

04.7 

0 

55 

4 

21 

72 

0.  150 

0.48 

12.0 

0 

17 

5 

21 

30 

0.098 

0.38 

09.8 

3 

61 

6 

21 

200 

0.038 

0.48 

12.8 

2 

43 

7 

21 

5 

0.098 

0.48 

11.6 

4 

64 

8 

21 

43 

0.062 

0.52 

08.7 

0 

16 

9 

21 

60 

0.062 

0.41 

10.0 

2 

58 

10 

21 

177 

0.098 

0.38 

09.8 

6 

82 

U 

21 

196 

0.  150 

0.45 

07.0 

1 

54 

12 

21 

151 

0.  150 

0.48 

12.0 

1 

28 

13 

21 

28 

0.062 

0.46 

12.0 

5 

14 

21 

91 

0.062 

0.48 

12.4 

4 

99 

15 

21 

8 

0.098 

0.53 

04.7 

3 

52 

16 

21 

77 

0.  150 

0.53 

04.7 

1 

34 

17 

21 

82 

0.098 

0.53 

04.7 

3 

41 

18 

21 

79 

0.098 

0.53 

04.7 

3 

16 

19 

21 

78 
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TABLE  10  (Continued) 


/  PASS8AND  \ 

CONTRAST 

GRAIN 

^RESOLUTION/ 

RESOLUTION 

(flim"* ) 

0.35 

0.038 

0.46 

09.5 

0.22 

0.098 

0.29 

04.4 

0. 1  1 

0.038 

0.41 

10.0 

0.58 

0.062 

0.34 

06.3 

0.311 

0.062 

0.47 

11.2 

0.26 

0.062 

0.48 

12.0 

0.27 

0.098 

0.43 

04.8 

0.39 

0.098 

0.43 

04.8 

0.74 

0.062 

0.46 

12.3 

0.48 

0.062 

0.48 

16.6 

0.  18 

0.062 

0.43 

04.8 

0.26 

0.062 

0.51 

17.6 

I.IO 

0.098 

0.42 

14.9 

0.21 

0.  ISO 

0.51 

17.6 

0.24 

0.098 

0.46 

12.3 

0.  15 

0.150 

0.33 

04.3 

0.24 

0.098 

0.37 

14.0 

0. 1  1 

0.038 

0.51 

17.6 

0. 12 

0.  038 

0.51 

17.6 

0.32 

0.062 

0.55 

09.5 

0. 14 

0.150 

0.33 

04.3 

0.27 

0.038 

0.55 

09.5 

0.32 

0.  150 

0.51 

17.6 

0.43 

0.038 

0.49 

16.8 

0.75 

0. 150 

0.37 

14.0 

0.13 

0.062 

0.52 

05.0 

0.21 

0.150 

0.51 

17.6 

0.34 

0.038 

0.42 

14.9 

0.29 

0.098 

0.52 

18.0 

0.35 

0.098 

0.50 

15.0 

0.38 

0.098 

0.55 

09.5 

0.57 

0.062 

0.34 

06.3 

0.34 

0.098 

0.42 

04.6 

0.89 

0.062 

0.46 

12.0 

0.96 

0.098 

0.52 

08.7 

0.50 

0.038 

0  38 

09.8 

0.33 

0.062 

0.52 

08.7 

0.34 

0.098 

0.45 

07.0 

0.32 

0.062 

0.48 

12.0 

0.29 

0.062 

0.48 

12.4 

0.60 

0.098 

0.41 

10.0 

0.38 

0.098 

0.52 

08.7 

NUM8ER 

MEAN 

SET  UP 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

(in  %) 

20 

21 

1 16 

21 

21 

243 

22 

21 

173 

23 

21 

227 

24 

21 

108 

25 

21 

24 

1 

47 

1 

22 

164 

1 

59 

2 

22 

162 

4 

90 

3 

22 

121 

1 

50 

4 

22 

37 

0 

22 

5 

22 

160 

3 

62 

6 

22 

24 

6 

71 

7 

22 

181 

0 

18 

8 

22 

29 

0 

39 

9 

22 

130 

0 

39 

10 

22 

249 

1 

38 

1 1 

22 

204 

0 

10 

12 

22 

20 

3 

34 

13 

22 

19 

3 

64 

14 

22 

58 

0 

28 

15 

22 

250 

1 

43 

16 

22 

51 

6 

41 

17 

22 

27 

3 

59 

18 

22 

86 

4 

28 

19 

22 

201 

20 

22 

75 

21 

22 

28 

22 

22 

172 

23 

22 

14 

24 

22 

113 

25 

22 

64 

2 

52 

1 

23 

227 

2 

34 

2 

23 

163 

3 

86 

3 

23 

91 

1 

66 

4 

23 

62 

3 

40 

5 

23 

186 

7 

70 

6 

23 

60 

3 

70 

7 

23 

150 

4 

58 

8 

23 

23 

2 

64 

9 

23 

10 

5 

81 

10 

23 

183 

4 

52 

1 1 

23 

65 

98 
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TABLE  10  (Continued) 


/ 

'  PASS8AND  \ 

NUMBER 

MEAN 

SET  UP 

CONTRAST 

GRAIN  \ 

.RESOLUTION/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

( »m“ * ) 

(in  )t) 

O.iil 

0.062 

0.47 

11.2 

4 

48 

12 

23 

108 

0.  17 

0.038 

0.48 

12.0 

2 

57 

13 

23 

20 

0.>i3 

0.098 

0.34 

06.3 

5 

69 

14 

23 

234 

0.58 

0.  150 

0.48 

12.0 

2 

84 

15 

23 

27 

0.7it 

0.098 

0.38 

09.8 

1 

64 

16 

23 

196 

0.  12 

0.098 

0.42 

04.6 

1 

06 

17 

23 

165 

0.3>i 

0.038 

0.52 

08.7 

4 

35 

18 

23 

51 

0. 10 

0.  150 

0.48 

12.0 

2 

04 

19 

23 

30 

0.  19 

0.038 

0.48 

12.0 

20 

23 

17 

0.33 

0.  150 

0.42 

04.6 

21 

23 

167 

0.57 

0.062 

0.48 

11.6 

22 

23 

37 

0.29 

0.098 

0.38 

09.8 

23 

23 

200 

0.66 

0.062 

0.48 

11.6 

24 

23 

36 

0.711 

0.062 

0.52 

08.7 

25 

23 

56 

0.91 

0.  150 

0.34 

07.5 

1 

69 

1 

24 

236 

0.7N 

0.098 

0.52 

05.0 

2 

60 

2 

24 

78 

0.83 

0.062 

0.42 

08.5 

1 

78 

3 

24 

142 

0.50 

0.062 

0.52 

05.0 

1 

24 

4 

24 

73 

O.NN 

0.038 

0.51 

17.6 

2 

40 

5 

24 

17 

0.46 

0.038 

0.51 

17.6 

5 

84 

6 

24 

19 

1.  II 

0.098 

0.50 

15.0 

4 

60 

7 

24 

113 

1.68 

0.098 

0.42 

14.9 

2 

70 

8 

24 

181 

0.84 

0.  150 

0.37 

14.0 

2 

52 

9 

24 

203 

0.93 

0.  150 

0.48 

16.6 

2 

64 

10 

24 

47 

0.54 

0.  150 

0.34 

07.5 

2 

52 

1 1 

24 

239 

0.64 

0.  150 

0.37 

14.0 

3 

32 

12 

24 

205 

0.74 

0.  150 

0.55 

09.5 

1 

44 

13 

24 

69 

0.28 

0.038 

0.55 

09.5 

6 

74 

14 

24 

55 

1.26 

0.098 

0.52 

18.0 

3 

78 

15 

24 

12 

0.69 

0.098 

0.42 

14.9 

6 

76 

16 

24 

185 

0.95 

0.062 

0.42 

14.9 

5 

31 

17 

24 

1 57 

1 . 14 

0.  150 

0.52 

05.0 

1 

34 

18 

24 

81 

0.95 

0.062 

0.42 

14.9 

3 

57 

19 

24 

177 

1.20 

0.098 

0.48 

16.6 

20 

24 

42 

0.98 

0.098 

0.46 

12.3 

21 

24 

129 

0.65 

0.062 

0.51 

17.6 

22 

24 

24 

1 .07 

0.062 

0.55 

09.5 

23 

24 

56 

1.29 

0.098 

0.43 

04.8 

24 

24 

161 

0.81 

0.062 

0.48 

16.6 

25 

24 

39 

0.36 

0.062 

0.42 

14.9 

1 

54 

1 

25 

180 

0.42 

0.098 

0.55 

09.5 

0 

49 

2 

25 

62 

0.63 

0.062 

0.42 

14.9 

2 

78 

3 

25 

177 

0.28 

0.038 

0.52 

18.0 

1 

28 

4 

25 

16 
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TABLE  10  (Continued) 


/  PASS8AND  \ 

NUM8ER 

MEAN 

SET  UP 

CONTRAST 

GRAIN 

V RE  SOLUTION/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

( mm" * ) 

(in  %) 

0.  14 

0.038 

0.42 

08.5 

1 

45 

5 

25 

138 

0.29 

0.  150 

0.43 

04.8 

0 

44 

6 

25 

169 

0.30 

0.  150 

0.48 

16.6 

1 

60 

7 

25 

48 

0.37 

0.062 

0.52 

05.0 

1 

22 

8 

25 

75 

0.55 

0.  150 

0.34 

07.5 

0 

47 

9 

25 

236 

0.39 

0.062 

0.34 

07.5 

3 

56 

10 

25 

229 

0.17 

0.038 

0.34 

07.5 

1 

24 

II 

25 

224 

0.29 

0.  150 

0.51 

17.6 

3 

38 

12 

25 

28 

0.53 

0.098 

0.48 

16.6 

0 

48 

13 

25 

42 

0.58 

0.098 

0.37 

14.0 

5 

81 

14 

25 

197 

0.21 

0.038 

0.  34 

07.5 

2 

35 

15 

25 

223 

0.44 

0.062 

0.48 

16.6 

2 

70 

16 

25 

40 

0.30 

0.062 

0.51 

17.6 

2 

49 

17 

25 

23 

0.47 

0.062 

0.42 

08.5 

4 

46 

18 

25 

141 

0.34 

0.  150 

0.46 

12.3 

4 

39 

19 

25 

133 

0.33 

0.098 

0.50 

15.0 

20 

25 

114 

0.49 

0.062 

0.51 

17.6 

21 

25 

22 

0.31 

0.  150 

0.33 

04.3 

22 

25 

248 

0.43 

0.062 

0,50 

15.0 

23 

25 

108 

0.36 

0.062 

0.37 

14.  0 

24 

25 

194 

0.39 

0.  150 

0.43 

04.8 

25 

25 

167 

0.17 

0.062 

0.38 

09.8 

1 

65 

1 

26 

195 

0.35 

0.062 

0.46 

12.0 

5 

61 

2 

26 

93 

0.32 

0.062 

0.48 

11.6 

5 

68 

3 

26 

38 

0.54 

0.098 

0.34 

06.3 

3 

55 

4 

26 

233 

0.35 

0.098 

0.47 

11.2 

1 

19 

5 

26 

114 

0.47 

0.098 

0.29 

04.4 

1 

33 

6 

26 

244 

0.98 

0.098 

0.46 

12.0 

3 

86 

7 

26 

96 

0.28 

0.098 

0.41 

10.0 

3 

69 

8 

26 

184 

0.82 

0.098 

0.48 

11.6 

2 

47 

9 

26 

42 

0. 19 

0.  150 

0.29 

04.4 

0 

36 

10 

26 

248 

0.62 

0.098 

0.42 

04.6 

2 

55 

1 1 

26 

162 

0.82 

0.098 

0.29 

04.4 

2 

31 

12 

26 

242 

0.35 

0.150 

0.38 

09.8 

1 

58 

13 

26 

202 

0.41 

0.062 

0.38 

09.8 

3 

83 

14 

26 

193 

0.51 

0.062 

0.48 

12.4 

2 

74 

15 

26 

7 

0.29 

0.038 

0.48 

12.4 

5 

87 

16 

26 

1 

0. 10 

0.038 

0.39 

08.8 

3 

38 

17 

26 

209 

0. 17 

0.  150 

0.29 

04.4 

2 

39 

18 

26 

249 

0.27 

0.  150 

0.45 

07.0 

4 

42 

19 

26 

153 

0.79 

0.062 

0.38 

09.8 

20 

26 

191 

0.30 

0.062 

0.47 

11.2 

21 

26 

108 

O.ll 

0.098 

0.48 

11.6 

22 

26 

45 

0.08 

0.150 

0.42 

04.6 

23 

26 

170 

0.  17 

0.038 

0.38 

09.8 

24 

26 

188 

0.  14 

0.038 

0.48 

11.6 

25 

26 

31 
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TABLE  10  (Continued) 


/ 

'  PASSBAND  \ 

NUMBER 

MEAN 

SET  UP 

CONTRAST 

GRAIN  \ 

^RESOLUTION/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

(mm”* ) 

(in 

0.  12 

0.038 

0.51 

17.6 

5 

66 

1 

27 

20 

1.28 

0.098 

0.55 

09.5 

4 

89 

2 

27 

61 

0.76 

0.  150 

0.48 

16.6 

4 

81 

3 

27 

46 

0.  15 

0.098 

0.48 

16.6 

0 

48 

4 

27 

45 

1.29 

0.098 

0.49 

16.8 

4 

59 

5 

27 

96 

l.0>( 

0.098 

0.43 

04.8 

2 

68 

6 

27 

161 

0.1(6 

0.062 

0.42 

08.5 

4 

78 

7 

27 

143 

I.04 

0.062 

0.46 

12.3 

3 

64 

8 

27 

121 

0.31 

0.062 

0.34 

07.5 

3 

44 

9 

27 

230 

0.68 

0.062 

0.43 

04.8 

2 

79 

10 

27 

1 57 

0.20 

0.  150 

0.46 

12.3 

3 

50 

II 

27 

135 

0.65 

0.062 

0.51 

17.6 

4 

70 

12 

27 

22 

0.59 

0.  150 

0.52 

05.0 

3 

38 

13 

27 

83 

0.4>( 

0. 150 

0.46 

12.3 

4 

74 

14 

27 

133 

0.37 

0.062 

0.42 

14.9 

3 

87 

15 

27 

178 

0.27 

0.150 

0.48 

16.6 

2 

56 

16 

27 

48 

0.21 

0.038 

0.42 

14.9 

3 

68 

17 

27 

175 

0.  II 

0.038 

0.39 

10.4 

1 

62 

18 

27 

209 

0.20 

0.038 

0.34 

07.5 

2 

14 

19 

27 

224 

0.50 

0.062 

0.49 

16.8 

20 

27 

93 

0.67 

0.038 

0.42 

14.9 

21 

27 

171 

0.71 

0.150 

0.33 

04.3 

22 

27 

247 

1.09 

0.098 

0.52 

18.0 

23 

27 

12 

0.09 

0.038 

0.55 

09.5 

24 

27 

55 

1.13 

0.098 

0.52 

18.0 

25 

27 

1 1 

0.23 

0.  150 

0.42 

04.2 

2 

50 

1 

28 

169 

0.61 

0. 150 

0.34 

06.3 

2 

39 

2 

28 

238 

0.51 

0.082 

0.39 

08.8 

3 

80 

3 

28 

213 

0.72 

0.062 

0.45 

07.0 

0 

66 

4 

28 

142 

0.27 

0. 150 

0.48 

11.6 

2 

30 

5 

28 

49 

0.20 

0.098 

0.39 

08.8 

1 

74 

6 

28 

220 

0.66 

0.062 

0.42 

04.6 

1 

62 

7 

28 

157 

0.31 

0.  150 

0.53 

04.7 

1 

30 

8 

28 

84 

0.74 

0.098 

0.41 

10.0 

2 

60 

9 

28 

183 

0.78 

0.038 

0.38 

09.8 

2 

34 

10 

28 

187 

0.59 

0.  150 

0.48 

11.8 

3 

49 

II 

28 

47 

0.98 

0.082 

0.42 

04.6 

2 

56 

12 

28 

1 56 

0.69 

0.062 

0.46 

12.0 

1 

57 

13 

28 

92 

0.44 

0.038 

0.46 

12.0 

8 

85 

14 

28 

86 

0.86 

0.  150 

0.46 

09.5 

3 

50 

15 

28 

131 

0.84 

0.062 

0.47 

11.2 

2 

56 

16 

28 

106 

0.97 

0.062 

0.38 

09.8 

3 

47 

17 

28 

192 

0.61 

0.098 

0.45 

07.0 

2 

52 

18 

28 

148 

0.88 

0.098 

0.46 

12.0 

4 

84 

19 

28 

97 

0.24 

0.038 

0.48 

12.0 

20 

28 

89 
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TABLE  10  (Continued) 


/ 

passbandN 

NUMBER 

MEAN 

SET  UP 

CONTRAST 

GRAIN  \ 

.RESOLUTION/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

( mm“ * ) 

( in 

0.39 

0.038 

0.47 

11.2 

21 

28 

101 

0.26 

0.150 

0.45 

07.0 

22 

28 

153 

0.67 

0.  150 

0.29 

04.4 

23 

28 

246 

0.44 

0.098 

0.53 

04.7 

24 

28 

79 

0.61 

0.062 

0.47 

11.2 

25 

28 

107 

0.82 

0.098 

0.55 

09.5 

1 

61 

1 

29 

63 

0.45 

0.062 

0.37 

14.0 

2 

20 

2 

29 

195 

0.66 

0.098 

0.42 

14.9 

2 

60 

3 

29 

183 

0.46 

0.038 

0.42 

14.9 

1 

63 

4 

29 

172 

0.83 

0.098 

0.33 

04.3 

0 

57 

5 

29 

241 

0.31 

0.062 

0.43 

04.8 

0 

22 

6 

29 

160 

0.57 

0.038 

0.49 

16.8 

1 

49 

7 

29 

86 

0.31 

0.  150 

0.43 

04.8 

0 

20 

8 

29 

169 

0.27 

0.  150 

0.51 

17.6 

1 

15 

9 

29 

29 

0.48 

0.  150 

0.52 

05.0 

0 

54 

10 

29 

82 

0.31 

0.038 

0.48 

16.6 

0 

38 

II 

29 

31 

0.20 

0. 150 

0.55 

09.5 

2 

10 

12 

29 

70 

1.08 

0.098 

0.43 

04.8 

1 

29 

13 

29 

161 

0.77 

0.038 

0.37 

14.0 

3 

74 

14 

29 

186 

0.44 

0.098 

0.42 

14.9 

0 

71 

15 

29 

185 

0.46 

0.098 

0.39 

10.4 

3 

59 

16 

29 

218 

0. 14 

0.038 

0.39 

10.4 

1 

02 

17 

29 

210 

0.82 

0.062 

0.48 

16.6 

2 

59 

18 

29 

36 

0.26 

0.098 

0.37 

14.0 

1 

05 

19 

29 

200 

0.61 

0. 150 

0.37 

14.0 

20 

29 

203 

0.23 

0.098 

0.37 

14.0 

21 

29 

199 

0.  18 

0.098 

0.49 

16.8 

22 

29 

100 

0.40 

0.062 

0.39 

10.4 

23 

29 

213 

0.57 

0.  II 

0.098 

0.038 

0.48 

0.42 

16.6 

08.5 

24 

25 

29 

29 

43 

140 

0.37 

0.098 

0.52 

18.0 

3 

75 

1 

30 

13 

0.  18 

0.038 

0.55 

09.5 

1 

25 

2 

30 

53 

0.  1 1 

0.038 

0.46 

12.3 

1 

73 

3 

30 

1 19 

0.  19 

0.038 

0.39 

10.4 

3 

60 

4 

30 

207 

0.  14 

0.038 

0.39 

10.4 

0 

30 

5 

30 

208 

0.32 

0.062 

0.39 

10.4 

8 

78 

6 

30 

214 

0.53 

0.062 

0.51 

17.6 

6 

94 

7 

30 

21 

0.  12 

0.038 

0.46 

12.3 

2 

69 

8 

30 

1 18 

0.39 

0.062 

0 . 39 

10.4 

4 

36 

9 

30 

213 

0.17 

0.062 

0.50 

15.0 

2 

36 

10 

30 

1 10 

0.  15 

0.038 

0.39 

10.4 

1 

45 

II 

30 

210 

0.71 

0.062 

0.48 

16.6 

6 

53 

12 

30 

36 

1.03 

0.062 

0. 39 

10.4 

7 

69 

13 

30 

21 1 
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TABLE  10 


/  PASS8AND  \ 

CONTRAST 

GRAIN 

^RESOLUTION/ 

RESOLUTION 

( mm" * ) 

0.  12 

0.038 

0.48 

16.6 

0.38 

0.098 

0.48 

16.6 

0.  19 

0.062 

0.46 

12.3 

0.54 

0.062 

0.42 

14.9 

0.  10 

0.038 

0.49 

16.8 

0.55 

0.062 

0.39 

10.4 

0.  13 

0.150 

0.48 

16.6 

0.  18 

0.098 

0.33 

04.4 

0.89 

0.038 

0.39 

10.4 

0.37 

0.098 

0.39 

10.4 

0.42 

0.150 

0.39 

14.0 

0.52 

0. 150 

0.39 

14.0 

0.  12 

0.098 

0.52 

05.0 

0.30 

0.062 

0.39 

08.8 

0.06 

0.038 

0.52 

08.7 

0.20 

0.038 

0.34 

06.3 

0.04 

0.038 

0.46 

09.5 

0.  18 

0.038 

0.48 

11.4 

0.  II 

0.098 

0.53 

04.7 

0.  15 

0.098 

0.39 

08.8 

0.48 

0.098 

0.47 

11.2 

0.09 

0.098 

0.42 

04.6 

0.  13 

0.  150 

0.42 

04.6 

0.23 

0.098 

0.42 

04.6 

0.04 

0.038 

0.47 

11.2 

0.09 

0.062 

0.46 

12.3 

0.08 

0.062 

0.52 

05.0 

0. 13 

0.  150 

0.29 

04.4 

0.  19 

0.098 

0.46 

09.5 

0.  10 

0.038 

0.48 

12.0 

0.22 

0.098 

0.53 

04.7 

0.06 

0. 150 

0.46 

09.5 

0.  16 

0.062 

0.50 

15.0 

0.09 

0.062 

0.34 

06.3 

0. 19 

0.062 

0.50 

15.0 

0.17 

0.098 

0.46 

12.0 

0.20 

0.062 

0.34 

06.3 

0.32 

0.062 

0.52 

05.0 

1.49 

0.098 

0.48 

16.6 

0.85 

0.  150 

0.48 

16.6 

0.22 

0.038 

0.48 

16.6 

0.68 

0.150 

0.51 

17.6 

0.75 

0.038 

0.48 

16.6 

(Continued) 


NUMBER 

MEAN 

SET  UP 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

(In  %) 

2 

60 

14 

30 

33 

4 

94 

15 

30 

44 

3 

59 

16 

30 

125 

8 

85 

17 

30 

177 

4 

51 

18 

30 

90 

7 

48 

19 

30 

212 

20 

30 

49 

21 

30 

244 

22 

30 

206 

23 

30 

219 

24 

30 

201 

25 

30 

202 

1 

12 

1 

31 

62 

1 

33 

2 

31 

214 

0 

00 

3 

31 

55 

0 

21 

4 

31 

223 

0 

17 

5 

31 

118 

1 

03 

6 

31 

35 

1 

31 

7 

31 

80 

0 

01 

8 

31 

219 

4 

37 

9 

31 

III 

1 

16 

10 

31 

162 

0 

14 

II 

31 

168 

0 

05 

12 

31 

165 

0 

01 

13 

31 

105 

2 

69 

14 

31 

123 

1 

00 

15 

31 

75 

1 

10 

16 

31 

243 

2 

22 

17 

31 

128 

1 

13 

18 

31 

4 

0 

13 

19 

31 

76 

20 

31 

135 

21 

31 

106 

22 

31 

230 

23 

31 

107 

24 

31 

98 

25 

31 

226 

1 

63 

1 

32 

74 

2 

93 

2 

32 

41 

2 

76 

3 

32 

47 

0 

64 

4 

32 

35 

1 

39 

5 

32 

27 

3 

72 

6 

32 

31 
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TABLE  10  (Continued) 


/  PASSBAND  \ 

CONTRAST  GRAIN  VRESOLUTION/  RESOLUTION 

( mm" * ) 

1.41  0.062  0.37  l‘t.0 


0.80 

0.098 

0.65 

0.038 

0.  19 

0.038 

0.43 

0.098 

0.77 

0.062 

0.41 

0.  150 

0.97 

0.038 

0.40 

0.098 

0.8  1 

0.  150 

1.27 

0.  150 

1.16 

0.062 

0.82 

0.  150 

0.  13 

0.038 

1.  16 

0.062 

0.66 

0.  150 

0.79 

0.062 

0.  14 

0.038 

0.75 

0.098 

0.55 

0.062 

0.40 

0.038 

0.52 

0.062 

1.12 

0.150 

0.71 

0.062 

0.54 

0.062 

1.82 

0.098 

0.  35 

0.038 

1.27 

0.  150 

0.77 

0.062 

0.76 

0.062 

0.43 

0.038 

C.80 

0.062 

1.41 

0.062 

1.35 

0.098 

0.91 

0.098 

1.03 

0.062 

0.64 

0.062 

0.39 

0.038 

0.61 

0.  150 

0.71 

0.062 

0.47 

0.  150 

1.22 

0.  150 

1.48 

0.150 

1.54 

0.098 

0.46  12.3 


0.34 

07.5 

0.46 

12.3 

0.34 

07.5 

0.49 

16.8 

0.46 

12.3 

0.42 

08.5 

0.33 

04.3 

0.34 

07.5 

0.34 

07.5 

0.39 

10.4 

0.51 

17.6 

0.55 

09.5 

0.52 

18.0 

0.34 

07.5 

0.55 

09.  5 

0.42 

08.5 

0.33 

04.3 

0.48 

12.0 

0.52 

08.7 

0.53 

04.7 

0.48 

12.0 

0.52 

08.7 

0.48 

11.6 

0.29 

04.4 

0.47 

11.2 

0.53 

04.7 

0.38 

09.8 

0.53 

04.7 

0.48 

11.6 

0.48 

12.4 

0.39 

08.8 

0.53 

04.7 

0.34 

06.3 

0.48 

12.4 

0.46 

12.0 

0.46 

12.0 

0.45 

07.0 

0.48 

12.4 

0.45 

07.0 

0.52 

08.7 

0.34 

06.3 

0.46 

09.5 

NUMBER 

RIGHT 


5 

1 

2 
I 
I 

4 

1 

2 
0 

1 

2 
2 
3 


5 

4 

2 

2 

1 

2 
3 
3 
2 

1 

2 
3 
3 
5 
3 
3 
3 
5 
5 


MEAN 

CONFIDENCE 

P.  1 . 

SCENE 

SET  UP 
NUMBER 

(in  $) 

81 

7 

32 

191 

42 

8 

32 

128 

53 

9 

32 

221 

65 

10 

32 

120 

40 

1 1 

32 

235 

58 

12 

32 

92 

45 

13 

32 

134 

83 

14 

32 

136 

26 

15 

32 

245 

35 

16 

32 

237 

27 

17 

32 

236 

58 

18 

32 

21  1 

48 

19 

32 

26 

20 

32 

54 

21 

32 

6 

22 

32 

238 

23 

32 

57 

24 

32 

140 

25 

32 

243 

68 

1 

33 

25 

59 

2 

33 

54 

52 

3 

33 

74 

60 

4 

33 

26 

26 

5 

33 

58 

44 

6 

33 

39 

41 

7 

33 

242 

50 

8 

33 

105 

30 

9 

33 

81 

46 

10 

33 

193 

56 

1 1 

33 

75 

32 

12 

33 

34 

60 

13 

33 

10 

88 

14 

33 

21  1 

62 

15 

33 

76 

37 

16 

33 

235 

65 

17 

33 

6 

72 

18 

33 

95 

61 

19 

33 

90 

20 

33 

153 

21 

33 

7 

22 

33 

155 

23 

33 

67 

24 

33 

236 

25 

33 

126 

104 
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TABLE  10  (Continued) 


/ 

'  PASSBAND  \ 

MEAN 

SET  UP 

CONTRAST 

GRAIN  \ 

*  RESOLUTION/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

( mtn”  * ) 

(in  /.) 

0.8>l 

0.098 

0.11 

10.0 

3 

61 

1 

31 

181 

0.10 

0.098 

0.18 

11.6 

3 

85 

2 

31 

13 

0.39 

0.  150 

0.18 

1 1.6 

3 

72 

3 

31 

19 

0.17 

0.062 

0.18 

12.1 

2 

57 

1 

31 

9 

0.88 

0.062 

0.16 

09.5 

1 

71 

5 

31 

121 

1.20 

0.098 

0.16 

12.0 

5 

99 

6 

31 

99 

0.38 

0.  150 

0.53 

01.7 

1 

68 

7 

31 

85 

0.67 

0.062 

0.17 

07.0 

2 

61 

8 

31 

111 

0.92 

0.098 

0.12 

01.6 

2 

13 

9 

31 

161 

0.65 

0.038 

0.16 

09.5 

3 

72 

10 

31 

1 16 

0.11 

0.038 

0.18 

12.0 

7 

82 

1 1 

31 

19 

0.19 

0.038 

0.11 

10.0 

1 

23 

12 

31 

175 

0.55 

0.038 

0.31 

06.3 

5 

60 

13 

31 

225 

0.65 

0.098 

0.18 

12.1 

5 

81 

11 

31 

1 5 

0.81 

0.062 

0.16 

09.5 

1 

70 

15 

31 

122 

0.18 

0.038 

0.17 

11.2 

1 

67 

16 

31 

103 

0.92 

0.  150 

0.52 

08.7 

5 

83 

17 

31 

66 

0.85 

0.062 

0.18 

12.1 

3 

71 

18 

31 

7 

1.20 

0.  150 

0.16 

09.5 

1 

16 

19 

31 

131 

0.71 

0.062 

0.11 

10.0 

20 

31 

180 

0.18 

0.038 

0.16 

09.5 

21 

31 

1 17 

0.60 

0.  150 

0.15 

07.0 

22 

31 

151 

1.21 

0.098 

0.17 

11.2 

23 

31 

113 

0.89 

0.098 

0.18 

12.1 

21 

31 

11 

1.  15 

0.098 

0.16 

12.0 

25 

31 

98 

0.61 

0.  150 

0.37 

11.0 

2 

65 

1 

35 

201 

0.11 

0.098 

0.39 

10.1 

2 

13 

2 

35 

219 

0.11 

0.062 

0.39 

10.1 

3 

71 

3 

35 

215 

0.81 

0.062 

0.12 

11.9 

0 

52 

1 

35 

176 

0,53 

0.062 

0.13 

01.8 

0 

63 

5 

35 

1 56 

0.38 

0.  150 

0.16 

12.3 

2 

50 

6 

35 

1 35 

1.13 

0.098 

0.12 

11.9 

1 

59 

7 

35 

182 

0.73 

0.098 

0.52 

18.0 

1 

18 

8 

35 

1 5 

0.11 

0.  150 

0.55 

09.5 

0 

61 

9 

35 

70 

0.  38 

0.062 

0.52 

18.0 

1 

82 

10 

35 

8 

0.11 

0.150 

0.52 

05.0 

1 

33 

1 1 

35 

83 

0,36 

0.062 

0.13 

01.8 

1 

17 

12 

35 

1 58 

0,73 

0.038 

0.37 

11.0 

6 

67 

13 

35 

186 

0.18 

0.062 

0.39 

10.1 

6 

78 

11 

35 

211 

0.32 

0.  150 

0.33 

01.3 

0 

09 

15 

35 

219 

0 . 26 

0.038 

0.16 

12.3 

3 

56 

16 

35 

1 19 

0.71 

0.098 

0.16 

12.3 

3 

51 

17 

35 

1  30 

0.37 

0.038 

0.19 

16.8 

2 

58 

18 

35 

88 

0.12 

0.038 

0.19 

16.8 

2 

12 

19 

35 

86 

0,%l 

0.  150 

0.31 

07.5 

20 

35 

239 
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TABLE  10  (Continued) 


PASSBANP  \ 


CONTRAST 

GRAIN 

\ RESOLUTION/ 

RESOLUTION 

(mm"* ) 

0.47 

0.062 

0.46 

12.3 

0.38 

0.062 

0.50 

15.0 

0.36 

0.098 

0.50 

15.0 

CO 

o 

0.098 

0.42 

14.9 

0.67 

0.062 

0.49 

16.8 

0.  31 

0.  150 

0.46 

12.3 

0.  19 

0.062 

0.43 

04.8 

0.22 

0.038 

0.42 

14.9 

0.27 

0.038 

0.37 

14.0 

0.20 

0.062 

0.48 

16.6 

0.84 

0.062 

0.52 

05.0 

0.29 

0.  150 

0.55 

09.5 

0.23 

0.  150 

0.52 

05.0 

0.32 

0.098 

0.42 

08.5 

0.91 

0.098 

0.49 

16.8 

0.17 

0.038 

0.46 

12.3 

0.24 

0.038 

0.49 

16.8 

0.  19 

0.038 

0.52 

18.0 

0.08 

0.038 

0.34 

07.5 

0.75 

0.098 

0.52 

18.0 

0.56 

0.062 

0.51 

17.6 

0.  15 

0.  150 

0.34 

07.5 

0.58 

0.150 

0.34 

07.5 

0.72 

0.062 

0.55 

09.5 

0.60 

0.098 

0.34 

07.5 

0.09 

0.  150 

0.42 

08.5 

0. 16 

0.038 

0.37 

14.0 

0. 10 

0.038 

0.34 

07.5 

0.89 

0.062 

0.50 

15.0 

0.56 

0.062 

0.55 

09.5 

0.73 

0.098 

0.47 

11.2 

0.25 

0.  150 

0.45 

07.0 

0.46 

0.  150 

0.52 

08.7 

0. 14 

0.062 

0.41 

10.0 

0.23 

0.038 

0.39 

08.8 

0.32 

0.062 

0.52 

08.7 

0.29 

0.062 

0.48 

12.0 

0.37 

0.062 

0.52 

08.7 

0.77 

0.098 

0.39 

08.8 

0.62 

0.062 

0.48 

12.4 

0.27 

0.  150 

0.52 

08.7 

0.97 

0.062 

0.45 

07.0 

NUMBER 

MEAN 

SET  UP 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

(in  t) 

21 

35 

125 

22 

35 

1 10 

23 

35 

115 

24 

35 

185 

25 

35 

91 

2 

78 

1 

36 

132 

0 

41 

2 

36 

159 

2 

98 

3 

36 

174 

1 

78 

4 

36 

188 

2 

47 

5 

36 

38 

4 

99 

6 

36 

71 

1 

87 

7 

36 

68 

2 

84 

8 

36 

82 

1 

73 

9 

36 

149 

4 

94 

10 

36 

96 

7 

71 

II 

36 

1 17 

2 

51 

12 

36 

89 

3 

95 

13 

36 

3 

3 

86 

14 

36 

225 

5 

99 

15 

36 

1  1 

4 

86 

16 

36 

22 

2 

80 

17 

36 

240 

4 

83 

18 

36 

237 

4 

74 

19 

36 

56 

20 

36 

233 

21 

36 

154 

22 

36 

189 

23 

36 

224 

24 

36 

106 

25 

36 

57 

2 

78 

1 

37 

1 12 

1 

59 

2 

37 

152 

3 

91 

3 

37 

67 

2 

45 

4 

37 

180 

2 

48 

5 

37 

207 

2 

70 

6 

.  37 

59 

2 

88 

7 

37 

23 

2 

33 

8 

37 

58 

3 

76 

9 

37 

217 

2 

76 

10 

37 

6 

1 

41 

1 1 

37 

69 

4 

26 

12 

37 

141 

106 
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r 

t 
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TABLE  10  (Continued) 

/ 

'  PASS8AND  \ 

NUMBER 

MEAN 

SET  UP 

*  CONTRAST 

GRAIN  \ 

^RESOLUTION/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

[ 

r 

(mm“* ) 

(in  %) 

r 

[  0.37 

0.098 

0.46 

12.0 

5 

60 

13 

37 

99 

0.‘^9 

0.062 

0.48 

12.0 

7 

91 

14 

37 

22 

0.35 

0.150 

0.38 

09.8 

2 

82 

15 

37 

203 

>  O.itO 

0.150 

0.34 

06.3 

2 

45 

16 

37 

238 

0.09 

0.038 

0.48 

12.0 

3 

31 

17 

37 

20 

0.>^0 

0.038 

0.46 

09.5 

3 

64 

18 

37 

1 16 

0.  16 

0.038 

0.46 

12.0 

5 

36 

19 

37 

89 

0.40 

0.  150 

0.46 

09.5 

20 

37 

132 

0.58 

0.062 

0.39 

08.8 

21 

37 

212 

0.65 

0.096 

0.34 

06.3 

22 

37 

232 

0.20 

0.038 

0.41 

10.0 

23 

37 

172 

0. 17 

0.150 

0.29 

04.4 

24 

37 

250 

0.  1 1 

0.038 

0.46 

09.5 

25 

37 

120 

0.51 

0.062 

0.55 

09.5 

3 

53 

1 

38 

57 

0.46 

0.062 

0.51 

18.0 

2 

61 

2 

38 

21 

0.45 

0.062 

0.46 

12.0 

2 

85 

3 

38 

123 

0.35 

0.062 

0.51 

18.0 

3 

50 

4 

38 

25 

0.63 

0.098 

0.49 

16.8 

2 

50 

5 

38 

99 

0.  44 

0.150 

0.42 

08.5 

2 

63 

6 

38 

145 

0.52 

0.062 

0.37 

14.0 

2 

48 

7 

38 

193 

0.55 

0.062 

0.46 

12.0 

3 

61 

8 

38 

125 

0.57 

0.062 

0.52 

18.0 

2 

70 

9 

38 

6 

0.63 

0.098 

0.34 

07.5 

0 

38 

10 

38 

234 

0.34 

0.038 

0.50 

15.0 

5 

68 

1  1 

38 

103 

0.80 

0.098 

0.42 

08.5 

0 

30 

12 

38 

148 

0.86 

0.098 

0.37 

14.0 

3 

42 

13 

38 

197 

0.49 

0.098 

0.55 

09.5 

0 

75 

14 

38 

65 

0.23 

0.038 

0.39 

10.0 

2 

58 

15 

38 

210 

0.88 

0.098 

0. 48 

16.6 

1 

51 

16 

38 

41 

0.33 

0.  150 

0.42 

08.5 

1 

30 

17 

38 

1 55 

0.58 

0. 150 

0.43 

04.8 

2 

19 

18 

38 

166 

0.43 

0.150 

0.46 

12.3 

1 

23 

19 

38 

134 

0.62 

0.098 

0.43 

04.8 

20 

38 

163 

0.42 

0.098 

0.33 

04.3 

21 

38 

245 

0.21 

0.038 

0.42 

08.5 

22 

38 

139 

0.57 

0.150 

0.52 

05.0 

23 

38 

81 

0.72 

0.098 

0.52 

18.0 

24 

38 

13 

0.35 

0.038 

0.55 

09.5 

25 

38 

53 

0.22 

0.098 

0.48 

16.6 

0 

42 

1 

39 

45 

0.40 

0.062 

0.34 

07.5 

0 

45 

2 

39 

228 

1.09 

0.098 

0.42 

08.5 

1 

72 

3 

39 

1 1 1 

0.  17 

0.038 

0.42 

08.5 

0 

48 

4 

39 

140 

0.  18 

0.038 

0.37 

14.0 

0 

42 

5 

39 

190 

107 
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TABLE  10  (Continued) 


i 

(  PASS8AND  \ 

NUM8ER 

MEAN 

SET  UP 

CONTRAST 

GRAIN  1 

^  RESOLUTION/ 

RESOLUTION 

RIGHT 

CONFIDENCE 

P.  1. 

SCENE 

NUMBER 

( nwn“  * ) 

( in 

0.22 

0.  150 

0.52 

05.0 

1 

27 

6 

39 

85 

0.47 

0.098 

0.33 

04.3 

2 

44 

7 

39 

245 

0.66 

0.  150 

0.51 

17.6 

0 

63 

8 

39 

26 

0.  13 

0.038 

0.51 

17.6 

2 

61 

9 

39 

17 

0.  29 

0.  150 

0.33 

04.3 

0 

43 

10 

39 

247 

0.  10 

0.038 

0.39 

10.4 

1 

33 

1 1 

39 

208 

0.  15 

0.  150 

0.46 

12.3 

2 

35 

12 

39 

134 

0.27 

0.038 

0.48 

16.6 

3 

59 

13 

39 

31 

0.  18 

0.038 

0.52 

18.0 

4 

71 

14 

39 

2 

0.91 

0.098 

0.42 

08.5 

2 

95 

15 

39 

126 

0.55 

0.098 

0.43 

04.8 

1 

33 

16 

39 

162 

0.24 

0.  150 

0.43 

04.8 

1 

12 

17 

39 

167 

0.31 

0.  150 

0.42 

08.5 

1 

28 

18 

39 

152 

0.60 

0.098 

0.42 

14.9 

2 

44 

19 

39 

182 

0.36 

0.  150 

0.51 

17.6 

20 

39 

27 

0.22 

0.098 

0.42 

08.5 

21 

39 

148 

0.72 

0.098 

0.39 

14.0 

22 

39 

197 

0.  19 

0.062 

0.39 

10.4 

23 

39 

215 

0. 31 

0.062 

0.52 

18.0 

24 

39 

8 

0.84 

0.  1  50 

0.48 

16.6 

25 

39 

46 

0.62 

0.  150 

0.42 

04.6 

0 

54 

1 

40 

166 

0.48 

0.098 

0.38 

09.8 

3 

45 

2 

40 

199 

0.  10 

0.038 

0.45 

07.0 

1 

30 

3 

40 

139 

0.45 

0.062 

0.42 

04.6 

0 

53 

4 

40 

156 

0.88 

0.062 

0.46 

09.5 

3 

50 

5 

40 

121 

0.20 

0.098 

0.42 

04.6 

1 

27 

6 

40 

165 

0.  19 

0.062 

0.48 

11.6 

2 

60 

7 

40 

40 

0.32 

0.  150 

0.45 

07.0 

1 

43 

8 

40 

153 

0.30 

0.098 

0.42 

04.6 

1 

37 

9 

40 

163 

0.26 

0.  150 

0.53 

04.7 

0 

14 

10 

40 

84 

0.34 

0.062 

0.41 

10.0 

4 

64 

1 1 

40 

178 

0.07 

0.  150 

0.42 

04.6 

0 

02 

12 

40 

170 

0.23 

0.098 

0.48 

12.4 

2 

30 

13 

40 

14 

0.59 

0.038 

0.41 

10.0 

2 

94 

14 

40 

171 

0.  19 

0.038 

0.41 

10.0 

2 

48 

15 

40 

174 

0.79 

0.098 

0.53 

04.7 

4 

67 

16 

40 

76 

0.32 

0.038 

0.46 

12.0 

5 

62 

17 

40 

87 

0.52 

0.062 

0.53 

°04.7 

2 

54 

18 

40 

73 

0.59 

0.062 

0.53 

04.7 

0 

34 

19 

40 

72 

0.09 

0.038 

0.48 

12.0 

20 

40 

4 

0.  1 1 

0.  150 

0.48 

12.0 

21 

40 

30 

0.61 

0.098 

0.34 

06.3 

22 

40 

233 

0.40 

0.062 

0.34 

06.3 

23 

40 

228 

0.30 

0.062 

0.46 

12.0 

24 

40 

92 

0.79 

0.098 

0.39 

08.8 

25 

40 

217 

VE-  1667-G-l 


TABLE  II 

ASSIGNMENT  OF  MODIFIED  SCENES  TO  PHOTO  INTERPRETERS 


P.  1.  NO. 

1 

ORDER 

SCENE 

SETUP 

ORDER 

1 

19 

181 

1 

2 

34 

184 

2 

3 

10 

100 

3 

4 

37 

112 

4 

5 

35 

201 

5 

6 

27 

20 

6 

7 

2 

30 

7 

8 

II 

92 

8 

9 

16 

168 

9 

10 

20 

32 

10 

1 1 

4 

173 

II 

12 

39 

45 

12 

13 

3 

94 

13 

14 

28 

169 

14 

15 

36 

132 

15 

16 

24 

236 

16 

17 

18 

130 

17 

18 

5 

202 

18 

19 

21 

176 

19 

20 

6 

53 

20 

21 

40 

166 

21 

22 

31 

62 

22 

23 

7 

139 

23 

24 

17 

8 

24 

25 

13 

240 

25 

26 

12 

133 

26 

27 

22 

164 

27 

28 

14 

194 

28 

29 

38 

57 

29 

30 

1 

21 

30 

31 

8 

171 

31 

32 

9 

71 

32 

33 

25 

180 

33 

34 

15 

216 

34 

35 

23 

227 

35 

36 

26 

195 

36 

37 

29 

63 

37 

38 

30 

13 

38 

39 

32 

74 

39 

40 

33 

25 

40 

1.  NO.  2 

P.  1.  NO.  3 

SCENE 

SETUP 

ORDER 

SCENE 

9 

87 

1 

16 

14 

39 

2 

22 

22 

162 

3 

3 

5 

242 

4 

9 

20 

205 

5 

13 

1 

229 

6 

36 

6 

76 

7 

21 

15 

218 

8 

1 1 

II 

105 

9 

37 

7 

94 

10 

38 

8 

109 

1 1 

10 

21 

187 

12 

4 

2 

215 

13 

17 

19 

161 

14 

20 

12 

240 

15 

18 

13 

40 

16 

23 

16 

175 

17 

26 

30 

53 

18 

19 

3 

50 

19 

5 

29 

195 

20 

14 

23 

163 

21 

24 

39 

228 

22 

6 

17 

80 

23 

27 

31 

214 

24 

30 

24 

78 

25 

7 

18 

189 

26 

15 

26 

93 

27 

8 

10 

51 

28 

1 

25 

62 

29 

25 

27 

61 

30 

28 

28 

238 

31 

12 

40 

199 

32 

29 

32 

41 

33 

31 

36 

159 

34 

32 

33 

54 

35 

33 

37 

152 

36 

39 

34 

43 

37 

34 

35 

219 

38 

40 

38 

21 

39 

35 

4 

42 

40 

2 

109 

VE-1667- 

SETUP 

73 

121 

229 

66 

218 

I7it 

36 

220 

67 

123 

204 

80 

135 

144 

88 

91 
38 
28 
99 
1 18 

142 

70 

46 
1 19 
192 

250 

101 

203 

177 

213 

50 

183 

55 

47 
74 

Ml 

49 

139 

215 

145 


G-1 


P.  I.  NO.  4 


ORDER 

SCENE 

SETUP 

1 

26 

233 

2 

13 

138 

3 

30 

207 

>( 

27 

45 

5 

19 

221 

6 

14 

148 

7 

31 

223 

8 

8 

247 

9 

32 

35 

10 

35 

176 

1 1 

28 

142 

12 

40 

156 

13 

20 

21  1 

14 

33 

26 

15 

34 

9 

16 

16 

32 

17 

15 

71 

18 

21 

72 

19 

2 

217 

20 

29 

172 

21 

17 

137 

22 

1 

47 

23 

36 

188 

24 

37 

180 

25 

38 

25 

26 

39 

140 

27 

3 

225 

28 

4 

98 

29 

22 

37 

30 

18 

44 

31 

5 

56 

32 

23 

62 

33 

24 

73 

34 

6 

186 

35 

7 

228 

36 

25 

16 

37 

9 

237 

38 

10 

79 

39 

1 1 

192 

40 

12 

131 

TABLE  II  (Continued) 

p.  I.  NO.  5 


ORDER 

SCENE 

SETUP 

1 

13 

44 

2 

23 

186 

3 

6 

100 

4 

4 

191 

5 

7 

89 

6 

26 

114 

7 

5 

73 

8 

19 

224 

9 

8 

81 

10 

9 

132 

1 1 

25 

138 

12 

32 

27 

13 

10 

90 

14 

II 

155 

15 

14 

145 

16 

28 

49 

17 

33 

58 

18 

15 

248 

19 

27 

96 

20 

29 

241 

21 

38 

99 

22 

16 

143 

23 

30 

208 

24 

31 

1 18 

25 

17 

127 

26 

12 

1  13 

27 

18 

98 

28 

34 

124 

29 

20 

52 

30 

21 

30 

31 

22 

160 

32 

24 

17 

33 

35 

156 

34 

39 

190 

35 

36 

38 

36 

40 

121 

37 

37 

207 

38 

1 

149 

39 

2 

64 

40 

3 

10 

p.  I.  NO.  6 


RDER 

SCENE 

SETUP 

1 

1 1 

143 

2 

9 

50 

3 

17 

151 

4 

16 

77 

5 

35 

135 

8 

32 

31 

7 

37 

59 

8 

13 

63 

9 

29 

160 

10 

36 

71 

II 

12 

147 

12 

5 

52 

13 

33 

39 

14 

26 

244 

15 

14 

240 

16 

15 

249 

17 

27 

161 

18 

6 

192 

19 

8 

15 

20 

18 

21 

21 

19 

137 

22 

38 

145 

23 

39 

85 

24 

20 

150 

25 

40 

165 

26 

28 

220 

27 

34 

99 

28 

30 

214 

29 

7 

206 

30 

1 

221 

31 

22 

24 

32 

23 

60 

33 

10 

102 

34 

2 

187 

35 

21 

200 

36 

24 

19 

37 

25 

169 

38 

3 

2 

39 

31 

35 

40 

4 

128 

110 


VE-1667-G-1 


f 


TABLE  II  (Continued) 


P.l.  NO. 

7 

P.l.  NO. 

8 

P. 

1.  NO. 

9 

ORDER 

SCENE 

SETUP 

ORDER 

SCENE 

SETUP 

ORDER 

SCENE 

SETUP 

1 

31 

80 

1 

19 

96 

1 

36 

149 

2 

18 

115 

2 

13 

155 

2 

37 

217 

3 

5 

166 

3 

27 

121 

3 

13 

191 

4 

29 

86 

4 

18 

97 

4 

25 

236 

5 

23 

150 

5 

1 1 

215 

5 

27 

230 

6 

24 

113 

6 

7 

85 

6 

40 

163 

7 

25 

48 

7 

28 

84 

7 

15 

241 

8 

34 

85 

8 

5 

34 

8 

16 

222 

9 

15 

149 

9 

6 

232 

9 

8 

152 

10 

14 

32 

10 

20 

4 

10 

10 

23 

1  1 

10 

52 

1 1 

8 

7 

II 

6 

189 

12 

1 

60 

12 

31 

219 

12 

39 

17 

13 

30 

21 

13 

29 

169 

13 

3 

62 

14 

32 

191 

14 

IS 

136 

14 

32 

221 

IS 

35 

182 

15 

21 

43 

IS 

22 

130 

16 

4 

198 

16 

14 

3 

16 

38 

6 

17 

21 

5 

17 

23 

23 

17 

23 

10 

18 

16 

205 

18 

16 

206 

18 

9 

146 

19 

20 

222 

19 

38 

125 

19 

35 

70 

20 

8 

168 

20 

30 

1  18 

20 

14 

26 

21 

22 

181 

21 

32 

128 

21 

24 

203 

22 

6 

72 

22 

12 

1 10 

22 

19 

166 

23 

40 

40 

23 

33 

105 

23 

28 

183 

24 

33 

242 

24 

40 

153 

24 

17 

100 

25 

36 

68 

25 

9 

164 

25 

18 

131 

26 

37 

23 

26 

35 

15 

26 

29 

29 

27 

2 

137 

27 

37 

58 

27 

1 

151 

28 

3 

83 

28 

22 

29 

28 

21 

60 

29 

17 

1 1 

29 

10 

171 

29 

2 

112 

30 

12 

87 

30 

25 

75 

30 

20 

71 

31 

26 

96 

31 

24 

181 

31 

26 

42 

32 

1  1 

219 

32 

34 

144 

32 

5 

136 

33 

19 

63 

33 

17 

198 

33 

7 

35 

34 

7 

53 

34 

26 

184 

34 

30 

213 

35 

13 

144 

35 

36 

82 

35 

31 

1 1 1 

36 

9 

138 

36 

39 

26 

36 

4 

184 

37 

27 

143 

37 

1 

133 

37 

II 

199 

38 

28 

157 

38 

2 

173 

38 

12 

124 

39 

38 

193 

39 

3 

61 

38 

33 

81 

40 

39 

245 

40 

4 

59 

40 

34 

164 

111 

VE- 

•1667- 

1 

0 

1 

TABLE  M  (Continued) 


P.  I.  NO.  10 

ORDER  SCENE  SETUP 


1 

32 

120 

2 

33 

193 

3 

6 

102 

>1 

29 

82 

5 

37 

6 

6 

7 

44 

7 

26 

248 

8 

35 

8 

9 

24 

47 

10 

20 

196 

1 1 

39 

247 

12 

1 

136 

13 

14 

150 

14 

9 

158 

15 

27 

157 

16 

34 

1 16 

17 

18 

29 

18 

8 

201 

19 

36 

96 

20 

12 

115 

21 

17 

58 

22 

II 

147 

23 

5 

216 

24 

4 

64 

25 

19 

18 

26 

30 

1 10 

27 

38 

234 

28 

21 

177 

29 

28 

187 

30 

10 

164 

31 

40 

84 

32 

13 

105 

33 

22 

249 

34 

15 

217 

35 

16 

235 

36 

31 

162 

37 

2 

212 

38 

3 

233 

39 

23 

183 

40 

25 

229 

P.  I.  NO.  II 


RDER 

SCENE 

SETUP 

1 

40 

178 

2 

10 

234 

3 

7 

15 

4 

14 

169 

5 

38 

103 

6 

13 

198 

7 

20 

3 

8 

21 

196 

9 

37 

69 

10 

32 

235 

1 1 

33 

75 

12 

5 

231 

13 

2 

129 

14 

8 

1  15 

15 

34 

19 

16 

9 

102 

17 

31 

168 

18 

22 

204 

19 

1 1 

121 

20 

15 

245 

21 

39 

208 

22 

12 

63 

23 

16 

5 

24 

17 

77 

25 

18 

147 

26 

35 

83 

27 

19 

207 

28 

23 

65 

29 

24 

239 

30 

30 

210 

31 

1 

179 

32 

25 

224 

33 

26 

162 

34 

36 

1  17 

35 

27 

135 

36 

28 

47 

37 

29 

31 

38 

3 

154 

39 

4 

2 

40 

6 

222 

ORDER 

P.  1.  NO. 
SCENE 

12 

SETUP 

1 

2 

16 

2 

9 

74 

3 

36 

89 

4 

33 

34 

5 

15 

176 

6 

8 

12 

7 

34 

175 

8 

18 

209 

9 

40 

170 

10 

22 

20 

1 1 

17 

208 

12 

37 

141 

13 

1 

150 

14 

3 

66 

15 

4 

54 

16 

1 1 

239 

17 

35 

158 

18 

23 

108 

19 

5 

198 

20 

19 

1  19 

21 

6 

1  16 

22 

38 

148 

23 

39 

134 

24 

27 

22 

25 

7 

5 

26 

16 

146 

27 

20 

123 

28 

21 

151 

29 

24 

205 

30 

26 

242 

31 

25 

28 

32 

10 

10 

33 

12 

4 

34 

13 

120 

35 

28 

156 

36 

14 

250 

37 

29 

70 

38 

30 

36 

39 

31 

165 

40 

32 

92 

112 


VE-1667-G-1 


TABLE  II  (Continued) 


P.  1.  NO. 

13 

ORDER 

SCENE 

SETUP 

ORDER 

1 

27 

83 

1 

2 

24 

69 

2 

3 

30 

21  1 

3 

38 

197 

4 

5 

10 

209 

5 

6 

2 

107 

6 

7 

35 

186 

7 

8 

25 

42 

8 

9 

20 

124 

9 

10 

18 

175 

10 

II 

7 

146 

II 

12 

1 1 

230 

12 

13 

9 

127 

13 

14 

26 

202 

14 

15 

34 

225 

15 

16 

3 

9 

16 

17 

4 

65 

17 

18 

22 

19 

18 

19 

19 

244 

19 

20 

15 

246 

20 

21 

28 

92 

21 

22 

8 

213 

22 

23 

40 

14 

23 

24 

31 

105 

24 

25 

16 

55 

25 

26 

13 

147 

26 

27 

17 

114 

27 

28 

21 

28 

28 

29 

29 

161 

29 

30 

12 

104 

30 

31 

32 

134 

31 

32 

23 

20 

32 

33 

33 

10 

33 

34 

36 

3 

34 

35 

37 

99 

35 

36 

39 

31 

36 

37 

1 

137 

37 

38 

5 

123 

38 

39 

6 

77 

39 

40 

14 

238 

40 

1.  NO. 

14 

P.  1 

.  NO. 

15 

SCENE 

SETUP 

ORDER 

SCENE 

SETUP 

25 

197 

1 

7 

69 

21 

91 

2 

II 

226 

37 

22 

3 

15 

87 

II 

94 

4 

37 

203 

22 

58 

5 

34 

122 

33 

211 

6 

28 

131 

15 

244 

7 

40 

174 

2 

25 

8 

35 

249 

40 

171 

9 

6 

184 

14 

18 

10 

16 

194 

20 

35 

II 

32 

245 

23 

234 

12 

12 

165 

24 

55 

13 

18 

68 

1 

1 1 1 

14 

17 

170 

30 

33 

15 

29 

185 

38 

65 

16 

3 

134 

19 

226 

17 

4 

95 

31 

123 

18 

8 

16 

36 

225 

19 

30 

44 

32 

136 

20 

13 

97 

29 

186 

21 

19 

142 

18 

129 

22 

38 

210 

16 

104 

23 

33 

76 

17 

9 

24 

20 

1 14 

7 

195 

25 

31 

75 

39 

2 

26 

26 

7 

26 

193 

27 

21 

8 

3 

12 

28 

14 

17 

4 

220 

29 

5 

84 

5 

227 

30 

27 

178 

6 

83 

31 

10 

85 

27 

133 

32 

23 

27 

8 

40 

33 

22 

250 

34 

15 

34 

24 

12 

9 

14 

35 

36 

1 1 

10 

202 

36 

39 

126 

12 

68 

37 

1 

125 

35 

214 

38 

25 

223 

28 

86 

39 

2 

139 

13 

182 

40 

9 

157 

113 

VE- 

1667 

-G 

-1 

A 


P.  I.  NO.  16 

ORDER  SCENE  SETUP 


1 

27 

48 

2 

18 

25 

3 

15 

247 

4 

19 

158 

5 

24 

185 

6 

4 

61 

7 

40 

76 

8 

20 

231 

9 

34 

103 

10 

37 

238 

II 

29 

218 

12 

9 

57 

13 

16 

122 

14 

30 

125 

15 

35 

1  19 

16 

28 

106 

17 

31 

243 

18 

1 

69 

19 

32 

237 

20 

33 

235 

21 

25 

40 

22 

26 

1 

23 

36 

22 

24 

8 

39 

25 

38 

41 

26 

10 

159 

27 

39 

162 

28 

2 

67 

29 

3 

III 

30 

5 

13 

31 

6 

173 

32 

7 

242 

33 

II 

163 

34 

12 

3 

35 

17 

1 10 

36 

21 

77 

37 

22 

51 

38 

13 

104 

39 

14 

187 

40 

23 

196 

TA3LE  II  (Continued) 

P.  I.  NO.  17 


ORDER 

SCENE 

SETUP 

1 

9 

168 

2 

29 

210 

3 

10 

220 

4 

30 

177 

5 

37 

20 

6 

25 

23 

7 

21 

82 

8 

6 

223 

9 

32 

236 

10 

28 

192 

II 

24 

157 

12 

19 

70 

13 

2 

37 

14 

33 

6 

15 

3 

13 

16 

5 

93 

17 

23 

165 

18 

7 

79 

19 

1  1 

50 

20 

38 

155 

21 

26 

209 

22 

12 

59 

23 

1 

194 

24 

34 

66 

25 

27 

175 

26 

39 

167 

27 

13 

103 

28 

16 

170 

29 

31 

128 

30 

14 

181 

31 

15 

231 

32 

17 

179 

33 

40 

87 

34 

18 

61 

35 

20 

189 

36 

22 

27 

37 

35 

130 

38 

36 

240 

39 

4 

178 

40 

8 

132 

P.l.  NO.  18 


<DER 

SCENE 

SETUP 

1 

3 

185 

2 

17 

172 

3 

15 

227 

4 

18 

24 

5 

40 

73 

6 

16 

103 

7 

4 

101 

8 

20 

1 

9 

26 

249 

10 

5 

97 

II 

32 

21  1 

12 

35 

88 

13 

6 

188 

14 

37 

116 

15 

19 

16 

16 

21 

79 

17 

1 

193 

18 

22 

86 

19 

31 

4 

20 

23 

51 

21 

24 

81 

22 

33 

95 

23 

7 

212 

24 

2 

234 

25 

29 

36 

26 

25 

141 

27 

1 1 

156 

28 

27 

209 

29 

8 

143 

30 

9 

204 

31 

13 

126 

32 

34 

7 

33 

38 

166 

34 

36 

237 

35 

12 

122 

36 

28 

148 

37 

10 

246 

38 

39 

152 

39 

14 

45 

40 

30 

90 

1  14 


VE-1667-G-1 


TABLE  II  (Continued) 


P.l.  NO. 

19 

P.l.  NO. 

20 

P. 

1.  NO. 

21 

ORDER 

SCENE 

SETUP 

ORDER 

SCENE 

SETUP 

ORDER 

SCENE 

SETUP 

1 

25 

133 

1 

23 

17 

1 

23 

167 

2 

39 

182 

2 

32 

54 

2 

28 

101 

3 

16 

167 

3 

40 

4 

3 

15 

126 

4 

34 

131 

4 

13 

32 

4 

1 

93 

5 

40 

72 

5 

17 

1 

5 

3 

127 

6 

17 

159 

6 

26 

191 

6 

24 

129 

7 

18 

117 

7 

35 

239 

7 

40 

30 

8 

1 

183 

8 

10 

33 

8 

36 

154 

9 

19 

232 

9 

18 

94 

9 

30 

244 

10 

23 

>  30 

10 

24 

42 

10 

2 

144 

II 

2 

208 

II 

33 

153 

II 

26 

108 

12 

35 

86 

12 

30 

49 

12 

17 

205 

13 

3 

214 

13 

25 

114 

13 

29 

199 

14 

27 

224 

14 

1  1 

241 

14 

4 

41 

15 

4 

176 

15 

14 

II 

15 

32 

6 

16 

5 

229 

16 

15 

243 

16 

34 

1  17 

17 

38 

134 

17 

37 

132 

17 

22 

28 

18 

6 

48 

18 

16 

129 

18 

5 

228 

19 

7 

107 

19 

12 

52 

19 

6 

109 

20 

1 1 

128 

20 

34 

180 

20 

7 

54 

21 

12 

29 

21 

19 

237 

21 

12 

120 

22 

22 

201 

22 

21 

118 

22 

18 

66 

23 

30 

212 

23 

36 

233 

23 

35 

125 

24 

8 

18 

24 

3  1 

135 

24 
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ACCURACY  SCORE 


Fig.  19  (CONTINUED)  ACCURACY  SCORE  DISTRIBUTION  FOR  EACH  ORIGINAL  SCENE 
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ACCURACY  SCORE 


Fig.  20  ACCURACY  SCORE  DISTRIBUTION  FOR  EACH  PI  SUBJECT 
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